-- Logs begin at Wed 2022-06-15 09:50:27 UTC, end at Wed 2022-06-15 10:51:11 UTC. -- Jun 15 10:22:48.882530 dv-cinder-843493-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 10:22:48.891651 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:22:48 2022] *** Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: nodename: dv-cinder-843493-2-iscsi Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: machine: x86_64 Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: clock source: unix Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: pcre jit disabled Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: detected number of CPU cores: 4 Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: current working directory: / Jun 15 10:22:48.893665 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: your processes number limit is 47680 Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: your memory page size is 4096 bytes Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: detected max file descriptor number: 2048 Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: lock engine: pthread robust mutexes Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: thunder lock: enabled Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 10:22:48.894337 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:22:48.938162 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: Python main interpreter initialized at 0x55aa5d3c89c0 Jun 15 10:22:48.938162 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: python threads support enabled Jun 15 10:22:48.938162 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: your server socket listen backlog is limited to 100 connections Jun 15 10:22:48.938162 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:22:48.938479 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:22:48.938553 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: *** Operational MODE: preforking *** Jun 15 10:22:48.938812 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:22:48.938812 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: spawned uWSGI master process (pid: 103032) Jun 15 10:22:48.939023 dv-cinder-843493-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 10:22:48.943118 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: spawned uWSGI worker 1 (pid: 103033, cores: 1) Jun 15 10:22:48.943118 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: spawned uWSGI worker 2 (pid: 103034, cores: 1) Jun 15 10:22:48.943118 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:22:49.591703 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:22:49.592301 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:22:50.755522 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:22:50.755522 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: from cryptography.utils import int_from_bytes Jun 15 10:22:50.756259 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:22:50.756259 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: from cryptography.utils import int_from_bytes Jun 15 10:22:50.757643 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:22:50.757643 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: from cryptography.utils import int_from_bytes Jun 15 10:22:50.758082 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:22:50.758082 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: from cryptography.utils import int_from_bytes Jun 15 10:22:53.290017 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:22:53.290549 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:22:53.290645 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:22:53.291026 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:22:53.291139 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:22:53.291225 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:22:53.291414 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:22:53.291513 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:22:53.291726 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:22:53.291816 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.291994 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:22:53.292124 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.292372 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.292496 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.292695 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.292797 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293013 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293121 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293332 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293428 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293643 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293728 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.293953 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.294041 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.294270 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.294608 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.294775 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.294872 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.295080 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.295189 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.295417 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-2-iscsi {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.295512 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.295729 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.295820 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296028 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296122 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-2-iscsi {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296328 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296430 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296637 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296734 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.296941 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.297038 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.297252 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.297350 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.297551 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.297649 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.297871 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.298040 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.298702 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.298977 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.299244 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.299354 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.299555 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.299647 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.299871 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.299990 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.300168 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.300266 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.300507 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.300613 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.300826 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.300931 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.301113 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.301206 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.301428 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.301512 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.301729 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.301834 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.302048 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.302140 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-2-iscsi {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.302353 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.302452 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.302709 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.302808 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-2-iscsi {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.303016 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.303142 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.303376 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.303470 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.303688 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.303801 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304034 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304127 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304348 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304435 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304668 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304792 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.304967 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305067 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305286 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305411 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305592 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305680 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305901 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.305988 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.306213 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.306302 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.306510 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.306606 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.306811 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.306905 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.307130 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.307277 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.307439 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.307540 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.307735 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.307822 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308032 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308130 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308276 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308371 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308574 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308673 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.308857 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309031 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309163 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309251 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309483 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309584 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309728 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309824 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.309974 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310099 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310283 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310372 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310581 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310670 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310886 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.310979 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.311218 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.311326 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.311521 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.311616 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.311820 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.311907 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.312118 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.312218 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.312416 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.312504 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.312713 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.312813 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.313012 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.313108 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.313315 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.313414 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.313620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.313714 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.314490 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.314592 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.314796 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.314884 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.315141 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.315247 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.315436 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.315525 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.315757 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.315853 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316056 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316154 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316384 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316479 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316689 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.316996 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.317081 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.317301 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.317434 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.317615 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.317710 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.317913 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318012 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318212 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318300 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318509 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318596 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318812 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.318908 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319134 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319223 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319452 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319540 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319695 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319790 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.319992 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320088 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320291 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320423 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320588 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320685 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320886 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.320973 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.321185 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.321273 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.321481 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.321581 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.321773 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.321860 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322070 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322158 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322364 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322451 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322658 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322744 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.322955 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323055 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323279 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323369 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323577 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323670 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323875 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.323972 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.324174 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.324262 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.324471 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.324565 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.324772 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.324858 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325075 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325166 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325371 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325457 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325669 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325756 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.325965 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326054 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326263 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326355 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326561 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326656 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326860 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.326949 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.327179 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.327270 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.327487 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.327582 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.327784 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.327871 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328081 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328169 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328388 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328474 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328687 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328774 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.328986 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.329074 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.329287 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.329381 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.329618 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.329705 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.329915 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330007 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330217 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330312 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330515 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330605 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330813 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.330900 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.331128 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.331235 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.331429 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.331518 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.331726 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.331815 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332023 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332128 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332318 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332406 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332614 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332702 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.332909 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333004 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333219 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333306 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333507 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333594 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333809 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.333903 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.334107 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.334194 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.334405 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.334494 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.334707 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.334794 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.335010 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.335126 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.335350 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:22:53.335438 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.335686 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.335777 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.335994 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.336089 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.336322 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.336423 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.336646 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.336734 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.336959 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337050 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337268 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337364 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337581 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337676 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337890 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.337977 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.338196 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.338291 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.338503 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.338591 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.338807 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.338895 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.339139 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.339250 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.339447 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.339535 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.339765 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.339878 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.340076 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.340171 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.340388 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.340484 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.340700 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.340787 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341007 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341104 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341319 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341407 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341625 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341711 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.341940 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342037 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342242 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342409 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342573 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342661 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342881 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.342972 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.343230 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.343319 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.343557 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.343645 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.343875 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.343963 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.344182 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.344269 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.344490 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.344578 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.344796 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.344886 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.345127 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.345213 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.345436 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.345532 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.345755 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.345841 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346071 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346167 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346379 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346475 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346683 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346770 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.346988 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.347075 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.347320 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.347421 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.347629 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.347718 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.347938 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348033 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348247 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348349 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348557 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348656 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348866 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.348955 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.349178 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.349275 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.349485 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.349571 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.349787 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.349881 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350096 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350184 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350395 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350490 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350695 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350829 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.350995 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.351103 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.351324 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.351412 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.351621 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.351707 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.351926 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352021 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352229 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352317 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352538 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352624 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352863 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.352959 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.353162 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.353248 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.353468 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.353570 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.353773 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.353861 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354076 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354170 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354379 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354477 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354685 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354779 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.354990 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.355078 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.355314 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.355422 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.355620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.355715 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.355923 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356011 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356221 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356317 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356540 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356627 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356841 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.356937 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.357144 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.357248 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.357451 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.357539 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.357757 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.357864 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358061 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358150 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358365 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358452 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358669 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358756 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.358977 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.359065 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.359309 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.359395 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.359617 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.359707 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.359931 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.360027 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.360243 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.360339 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.360544 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.361128 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.361379 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.361479 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.361702 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.361789 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362017 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362114 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362317 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362405 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362625 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362720 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.362926 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363028 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363257 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363345 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363559 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363656 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363863 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.363961 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.364162 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.364258 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.364468 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.364772 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.364868 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365077 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365165 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365376 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365462 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365676 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365771 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.365981 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366069 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366285 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366371 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366586 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366686 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366886 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.366974 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.367209 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.367300 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.367516 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.367622 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.367845 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.367939 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.368154 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.368240 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.368495 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.368585 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.368805 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.368899 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.369124 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.369213 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.369432 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.369529 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.369740 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.369827 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370044 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370131 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370351 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370440 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370656 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370752 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.370962 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.371057 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.371292 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.371380 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.371594 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.371690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.371909 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372006 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372215 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372310 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372521 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372616 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372824 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.372921 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.373137 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.373223 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.373435 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.373521 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.373743 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.373839 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.374056 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.374151 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.374388 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.374474 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.374701 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.374798 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375018 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375134 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375351 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375479 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375660 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375762 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.375964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.376050 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.376318 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.376916 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.377159 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.377249 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.377473 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.377570 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.377786 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.377876 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.378106 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.378195 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.378415 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.378511 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.378719 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.378819 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379027 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379161 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379359 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379446 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379673 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379761 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.379975 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.380065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.380283 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.380380 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.380598 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.380695 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.380924 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381012 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381229 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381316 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381536 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381636 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381853 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.381949 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.382160 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.382247 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.382465 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.382563 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.382771 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.382868 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.383072 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.383180 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.383395 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.383495 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.383699 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.383786 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384008 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384096 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384314 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384403 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384619 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384706 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.384917 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385010 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385220 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385308 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385522 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385608 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385823 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.385911 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.386124 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.386213 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.386425 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.386512 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.386737 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.386824 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387041 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387185 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387377 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387463 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387693 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387781 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.387998 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388089 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388299 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388387 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388600 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388695 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388909 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.388995 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.389209 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.389304 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.389510 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.389605 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.389818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.389925 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.390109 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.390202 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.390443 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.390540 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.390751 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.390869 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.391058 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.391220 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.391395 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.391497 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.391699 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.391787 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392034 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392173 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392341 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392440 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392646 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392734 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.392953 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393039 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393259 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393347 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393563 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393650 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393868 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.393955 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.394171 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.394258 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.394477 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.394566 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.394781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.394870 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.395105 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.395202 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.395423 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.395509 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.395727 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.395836 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396032 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396120 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396333 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396444 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396637 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396746 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.396946 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.397042 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.397264 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.397504 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.397821 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.397928 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.398135 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.398228 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.398448 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.398545 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.398761 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.398876 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.399076 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.399194 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.399409 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.399497 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.399734 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.399823 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400056 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400141 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400362 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400458 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400667 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400764 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.400969 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401077 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401269 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401365 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401577 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401694 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401871 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.401968 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.402171 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.402259 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.402469 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.402556 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.402768 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.402857 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403065 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403184 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403389 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403476 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403686 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403774 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.403986 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404073 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404289 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404377 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404584 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404679 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404886 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.404974 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.405183 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.405270 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.405485 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.405573 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.405792 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.405877 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406091 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406187 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406477 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406687 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406775 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.406988 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.407111 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.407341 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.407428 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.408172 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.408267 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.408510 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.408616 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.408840 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.408927 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.409139 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.409227 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.409439 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.409529 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.409757 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.409846 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410056 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410144 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410356 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410453 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410655 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410751 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.410954 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411041 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411298 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411435 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411583 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411673 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411882 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.411973 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.412183 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.412285 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.412490 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.412576 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.412792 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.412888 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413089 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413178 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413389 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413477 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413689 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413784 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.413989 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414077 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414293 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414379 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414591 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414687 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414889 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.414989 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.415211 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.415302 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.415513 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.415613 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.415813 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.415902 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.416112 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.416200 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.416410 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.416498 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.416711 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.416800 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417007 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417094 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417305 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417402 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417602 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417900 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.417999 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.418202 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.418290 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.418507 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.418595 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.418810 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.418900 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.419135 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.419235 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.419722 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.419811 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420024 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420112 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420325 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420425 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420626 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420720 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.420927 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421022 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421229 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421317 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421535 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421624 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421843 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.421940 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.422143 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.422231 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.422450 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.422536 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.422746 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.422846 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.423045 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.423719 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.423904 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.423994 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.424206 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.424294 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.424503 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.424590 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.424802 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.424890 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.425100 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.425188 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.425398 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.425486 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.425697 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.425785 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426001 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426091 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426303 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426399 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426603 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426692 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426905 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.426993 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.427226 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.427318 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.427529 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.427626 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.427855 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.427943 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.428162 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.428246 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.428501 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.428597 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.428808 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.428895 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.429123 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.429211 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.429427 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.429526 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.429731 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.429827 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430037 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430126 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430334 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430435 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430639 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430733 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.430940 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.431027 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.431270 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.431372 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.431569 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.431655 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.431869 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432004 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432176 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432266 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432479 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432567 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432783 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.432878 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.433088 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.433176 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.433404 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.433491 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.433723 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.433817 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434020 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434108 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434325 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434413 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434630 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434718 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.434931 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435018 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435259 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435349 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435563 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435662 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435868 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.435955 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.436171 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.436267 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.436477 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.436574 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.436783 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.436869 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437086 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437172 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437385 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437482 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437687 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437774 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.437991 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.438078 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.438290 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.438426 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.438592 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.438679 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.438931 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439019 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439255 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439347 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439559 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439647 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439856 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.439943 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.440160 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.440247 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.440456 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.440550 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.440763 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.440872 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.441179 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.441267 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.441484 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.441573 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.441782 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.441878 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.442082 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.442171 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.442387 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.442474 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.442694 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.442791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.443003 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.443108 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.443328 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.443426 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.443629 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.443729 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444031 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444119 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444338 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444427 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444646 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444742 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.444942 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445029 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445242 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445331 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445545 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445642 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445855 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.445945 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.446152 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.446239 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.446454 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.446543 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.446753 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.446840 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.447053 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.447183 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.447383 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.447471 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.447689 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.447777 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.448011 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.448099 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.448397 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.448523 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.448699 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.448788 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.449016 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.449104 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.449399 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.449487 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.449706 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.449794 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450022 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450123 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450339 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450426 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450656 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450745 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.450959 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.451061 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.451294 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.451470 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.451599 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.451695 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.451910 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452001 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452224 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452325 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452529 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452618 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452839 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.452941 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.453141 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.453240 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.453445 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.453531 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.453764 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.453851 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.454074 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.454170 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.454408 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.454498 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.454731 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.454821 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.455140 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.455232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.455452 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.455542 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.455770 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.455858 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456180 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456391 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456482 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456692 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456788 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.456998 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.457096 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.457300 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.457388 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.457600 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.457688 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.457905 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458040 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458203 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458291 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458515 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458655 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458819 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.458908 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.459143 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.459234 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.459449 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.459554 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.459752 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.459840 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460058 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460154 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460359 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460456 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460677 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460764 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.460983 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.461079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.461299 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.461396 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.461617 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.461706 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.461919 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462014 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462234 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462323 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462538 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462632 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.462926 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.463158 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.463251 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.463461 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.463550 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.463765 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.463879 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.464093 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.464180 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.464400 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.464486 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.464723 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.464819 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465044 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465132 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465352 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465439 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465670 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465769 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.465989 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.466077 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.466303 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.466434 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.466617 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.466715 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.466934 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467022 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467268 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467357 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467569 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467670 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467871 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.467958 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.468172 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.468258 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.468472 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.468568 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.468772 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.468867 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.469074 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.469160 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.469370 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.469466 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.469669 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.469759 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.470469 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.470576 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.470778 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.470866 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.471133 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.471226 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.471413 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.471514 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.471719 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.471807 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472022 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472111 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472322 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472410 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472623 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472713 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.472925 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473012 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473249 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473349 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473560 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473648 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473877 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.473965 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.474195 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.474298 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.474514 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.474601 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.474817 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.474904 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.475166 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.475272 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.475474 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.475570 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.475785 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.475874 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.476096 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.476197 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.476406 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.476547 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.476715 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.476804 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477024 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477112 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477333 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477421 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477637 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477726 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.477944 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.478033 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.478252 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.478341 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.478563 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.478657 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.478882 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.479073 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.479420 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.479510 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.479730 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.479816 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480040 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480131 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480350 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480437 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480654 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480818 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.480962 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481050 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481267 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481575 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481672 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481879 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.481966 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.482187 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.482293 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.482494 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.482592 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.482811 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.482908 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.483151 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.483243 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.483476 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.483566 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.483788 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.483884 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.484101 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.484197 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.484411 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.484501 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.484721 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.484809 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.485030 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.485118 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.485370 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.485459 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.486237 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.486342 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.486549 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.486652 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.486864 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.486960 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.487197 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.487287 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.487510 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.487600 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.487818 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.487906 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.488126 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.488213 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.488437 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.488526 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.488745 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.488832 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489053 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489158 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489360 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489448 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489669 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489757 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.489983 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.490125 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.490306 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.490399 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.490622 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.490710 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.490932 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.491031 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.491265 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.491355 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.491577 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.491663 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.491893 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.492087 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.492399 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.492508 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.492718 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.492815 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493034 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493136 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493355 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493442 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493663 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493751 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.493972 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494060 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494289 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494378 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494589 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494674 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494891 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.494979 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.495220 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.495312 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.495529 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.495616 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.495830 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.495926 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.496133 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.496220 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.496440 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.496526 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.496742 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.496841 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.497041 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.497128 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.497348 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.497443 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.497654 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.497870 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.498182 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.498270 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.498513 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.498608 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.498831 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.498936 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.499173 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.499270 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.499489 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.499592 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.499793 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.499881 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.500107 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.500202 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.500408 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.500505 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.500710 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.500797 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501032 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501124 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501348 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501440 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501650 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501737 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.501951 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502039 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502258 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502343 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502563 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502660 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502865 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.502964 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.503184 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.503276 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.503488 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.503576 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.503788 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.503884 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.504099 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.504186 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.504401 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.504496 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.504701 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.504798 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505002 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505088 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505299 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505391 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505599 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505697 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505900 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.505994 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.506196 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.506282 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.506496 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.506595 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.506798 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.506921 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.507115 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.507214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.507412 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.507527 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.507717 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.507823 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508013 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508109 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508316 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508412 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508625 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508731 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.508963 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.509178 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.509339 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.509485 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.509630 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.509767 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.509904 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510039 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510253 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510392 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510535 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510678 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510815 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.510952 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.511116 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.511263 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.511399 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.511533 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.511668 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.511817 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.512010 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.512198 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.512535 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.512678 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.512853 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513011 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513172 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513260 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513507 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513597 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513810 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.513907 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.514117 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.514214 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.514421 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.514523 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.514725 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.514838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515036 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515187 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515368 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515458 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515674 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515762 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.515979 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.516065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.516284 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.516374 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.516589 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.516678 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.516915 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517015 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517223 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517311 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517528 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517626 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517832 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.517927 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.518137 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.518235 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.518442 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.518537 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.518747 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.518835 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.519053 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.519186 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.519390 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.519499 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.519712 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.519800 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520024 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520122 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520334 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520423 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520644 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520731 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.520948 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521044 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521251 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521348 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521553 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521641 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521857 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.521953 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.522164 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.522251 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.522492 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.522629 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.522783 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.522872 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.523103 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.523207 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.523413 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.523511 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.523804 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.523892 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.524118 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.524207 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.524433 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.524532 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.524738 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.524827 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525048 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525136 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525460 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525670 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525759 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.525980 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.526076 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.526284 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.526372 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.526596 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.526721 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.526923 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527058 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527274 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527364 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527596 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527686 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527896 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.527985 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.528197 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.528287 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.528500 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.528595 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.528802 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.528890 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.529108 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.529197 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.529418 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.529532 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.529716 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.529826 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530014 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530110 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530312 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530407 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530609 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530717 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.530907 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531004 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531228 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531324 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531525 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531625 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531823 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.531911 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.532122 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.532218 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.532418 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533048 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533250 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533349 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533545 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533633 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533844 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.533933 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.534141 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.534241 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.534440 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.534535 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.534737 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.534834 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535038 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535143 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535367 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535467 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535665 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535752 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.535965 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536051 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536265 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536353 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536595 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536691 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536905 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.536999 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.537221 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.537328 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.537522 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.537611 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.537835 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.537921 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.538139 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.538239 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.538453 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.538539 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.538768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.538863 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.539100 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.539276 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.539410 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.539498 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.539717 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.539819 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540070 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540164 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540336 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540425 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540644 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540731 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.540948 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541043 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541255 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541350 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541561 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541648 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541873 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.541962 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.542192 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.542278 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.542495 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.542591 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.542814 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.542915 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.543155 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.543246 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.543475 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.543587 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.543784 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.543871 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.544092 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.544179 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.544680 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.544780 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.544992 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545297 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545386 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545604 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545699 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545909 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.545994 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.546217 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.546303 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.546527 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.546615 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.546839 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.546970 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.547170 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.547273 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.547501 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.547598 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.547805 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.547893 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.548158 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.548748 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.548987 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.549083 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.549313 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.549401 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.549661 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.549763 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.549973 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.550069 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.550310 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.550397 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.550623 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.550720 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.550933 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.551022 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.551265 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.551353 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.551498 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103034) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:22:53.551598 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:22:53.551802 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:22:53.612441 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO dbcounter [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Registered counter for database nova_api Jun 15 10:22:53.613184 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO dbcounter [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Registered counter for database nova_api Jun 15 10:22:53.631937 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_db.sqlalchemy.engines [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.633637 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_db.sqlalchemy.engines [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.638563 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writer thread running {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.640018 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writer thread running {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.695390 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.context [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed046e13-dc35-409c-a39d-d673ce8dff73(cell1) {{(pid=103034) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:22:53.696934 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.context [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed046e13-dc35-409c-a39d-d673ce8dff73(cell1) {{(pid=103033) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:22:53.699522 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.701014 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_concurrency.lockutils [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.701112 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.701853 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.702571 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_concurrency.lockutils [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.703414 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_concurrency.lockutils [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:22:53.703848 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.705417 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_concurrency.lockutils [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:22:53.705805 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO dbcounter [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Registered counter for database nova_cell0 Jun 15 10:22:53.707387 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO dbcounter [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Registered counter for database nova_cell0 Jun 15 10:22:53.709702 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO dbcounter [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Registered counter for database nova_cell1 Jun 15 10:22:53.711109 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO dbcounter [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Registered counter for database nova_cell1 Jun 15 10:22:53.716786 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_db.sqlalchemy.engines [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.718366 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_db.sqlalchemy.engines [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.720700 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_db.sqlalchemy.engines [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.722700 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_db.sqlalchemy.engines [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.725763 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writer thread running {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.726490 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writer thread running {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.863070 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writer thread running {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.864545 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writer thread running {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.872741 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO dbcounter [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Registered counter for database nova_cell0 Jun 15 10:22:53.874282 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO dbcounter [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Registered counter for database nova_cell0 Jun 15 10:22:53.881601 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_db.sqlalchemy.engines [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103034) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.885014 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG oslo_db.sqlalchemy.engines [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:22:53.885942 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writer thread running {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:53.889295 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writer thread running {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:22:54.222443 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: WARNING keystonemiddleware.auth_token [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:22:54.225059 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: WARNING keystonemiddleware.auth_token [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:22:54.229645 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: WARNING keystonemiddleware.auth_token [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:22:54.232364 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: WARNING keystonemiddleware.auth_token [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:22:54.570358 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: WARNING keystonemiddleware.auth_token [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:22:54.575936 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: WARNING keystonemiddleware.auth_token [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:22:54.576308 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: WARNING keystonemiddleware.auth_token [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:22:54.582102 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa5d3c89c0 pid: 103034 (default app) Jun 15 10:22:54.582364 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: WARNING keystonemiddleware.auth_token [None req-00a7ef4f-808d-48fc-833e-7df7adb30428 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:22:54.584204 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:22:54.585382 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Jun 15 10:22:54.585785 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Jun 15 10:22:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:22:54.587662 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aa5d3c89c0 pid: 103033 (default app) Jun 15 10:24:10.173491 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:10.174474 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 15 10:24:10.175137 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:10.187027 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writing DB stats nova_api:SELECT=3 {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:10.188674 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writing DB stats nova_cell0:SELECT=3 {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:10.189547 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writing DB stats nova_cell1:SELECT=3 {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:10.190596 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:10.604994 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-cc769284-b2d8-4625-ac79-8c8a706ebed6 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:10.636539 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-cc769284-b2d8-4625-ac79-8c8a706ebed6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.454607 Jun 15 10:24:10.643155 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jun 15 10:24:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:12.779245 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:12.780256 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-448abc3e-a9cd-47fb-b79a-6a102adcd09a None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 15 10:24:12.780660 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:12.847238 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-8fe1216f-d5d3-416b-8de3-7ebedc525248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:12.866028 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:24:12.866028 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: warnings.warn(msg) Jun 15 10:24:12.895519 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-8fe1216f-d5d3-416b-8de3-7ebedc525248 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107847 Jun 15 10:24:12.899239 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:12.910086 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_api:SELECT=3 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:12.911008 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_cell1:SELECT=3 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:12.912112 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_cell0:SELECT=3 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:12.912851 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:13.115515 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-d8cfeb1d-6a69-4431-b860-06a0c70dc64e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:13.117835 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:24:13.117835 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: warnings.warn(msg) Jun 15 10:24:13.180298 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-d8cfeb1d-6a69-4431-b860-06a0c70dc64e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.275384 Jun 15 10:24:13.180298 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jun 15 10:24:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:15.348053 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-8fe1216f-d5d3-416b-8de3-7ebedc525248 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:15.349072 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-8fe1216f-d5d3-416b-8de3-7ebedc525248 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 15 10:24:15.349765 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:15.461416 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-7188db93-646d-4162-b9cb-c3532e4a05d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:15.479186 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:24:15.479186 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: warnings.warn(msg) Jun 15 10:24:15.501588 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-7188db93-646d-4162-b9cb-c3532e4a05d9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144392 Jun 15 10:24:15.501588 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:15.513327 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-773732d8-267d-46a5-8c7c-c4ea0b03ad70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:15.514925 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:24:15.514925 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: warnings.warn(msg) Jun 15 10:24:15.550532 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-773732d8-267d-46a5-8c7c-c4ea0b03ad70 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040925 Jun 15 10:24:15.551327 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jun 15 10:24:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:17.749418 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-7188db93-646d-4162-b9cb-c3532e4a05d9 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:17.750471 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-7188db93-646d-4162-b9cb-c3532e4a05d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 15 10:24:17.750868 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:17.822340 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-2b5fb219-bdc8-4f1b-9f4b-9e602191cc87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:17.844934 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-2b5fb219-bdc8-4f1b-9f4b-9e602191cc87 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087723 Jun 15 10:24:17.845735 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:17.858034 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-d2842f2f-6fc9-4938-93df-2cf79d9fad34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:17.884001 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-d2842f2f-6fc9-4938-93df-2cf79d9fad34 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030232 Jun 15 10:24:17.892047 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jun 15 10:24:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:20.061607 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-2b5fb219-bdc8-4f1b-9f4b-9e602191cc87 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:20.063251 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-2b5fb219-bdc8-4f1b-9f4b-9e602191cc87 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002097 Jun 15 10:24:20.063736 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:20.120976 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-80b588f0-3720-46a1-9363-917c976a8fd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "swap": 0}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:20.140692 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-80b588f0-3720-46a1-9363-917c976a8fd3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071222 Jun 15 10:24:20.141247 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:20.153082 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-3b5f43cb-13ae-416c-8d23-bef90b05b8d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:20.176200 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-3b5f43cb-13ae-416c-8d23-bef90b05b8d7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026849 Jun 15 10:24:20.176833 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jun 15 10:24:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:24:22.353704 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-80b588f0-3720-46a1-9363-917c976a8fd3 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:22.355177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-80b588f0-3720-46a1-9363-917c976a8fd3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 Jun 15 10:24:22.356095 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:22.424940 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-71e7e86b-a9df-4732-9eea-e765a91cc79b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 20, "swap": 0}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:22.445116 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-71e7e86b-a9df-4732-9eea-e765a91cc79b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082275 Jun 15 10:24:22.445992 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:24:22.457620 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-ec3317e6-0b7d-49b0-b0e4-11f79877f893 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:22.483484 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-ec3317e6-0b7d-49b0-b0e4-11f79877f893 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029449 Jun 15 10:24:22.485180 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Wed Jun 15 10:24:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:24.667683 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-71e7e86b-a9df-4732-9eea-e765a91cc79b admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:24.667683 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-71e7e86b-a9df-4732-9eea-e765a91cc79b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 15 10:24:24.670133 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:24.733227 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-d3fac8ba-51e5-4a7e-a8cd-19b4c3722939 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:24.757213 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-d3fac8ba-51e5-4a7e-a8cd-19b4c3722939 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083371 Jun 15 10:24:24.757839 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jun 15 10:24:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:24:27.060237 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-71e7e86b-a9df-4732-9eea-e765a91cc79b admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:27.061178 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-71e7e86b-a9df-4732-9eea-e765a91cc79b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 15 10:24:27.061578 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:27.122509 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-71a13df3-660a-4c22-acd1-2f1b08180b2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "disk": 1}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:27.142275 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-71a13df3-660a-4c22-acd1-2f1b08180b2a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074184 Jun 15 10:24:27.142826 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:24:27.154507 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-d7225c9e-544c-43cc-a40f-526c3309f506 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:27.178665 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-d7225c9e-544c-43cc-a40f-526c3309f506 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027758 Jun 15 10:24:27.179639 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jun 15 10:24:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:29.404504 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-71a13df3-660a-4c22-acd1-2f1b08180b2a admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:29.407066 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-71a13df3-660a-4c22-acd1-2f1b08180b2a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003208 Jun 15 10:24:29.407574 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:29.479364 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-c0425ecf-d4cf-4ff5-b15f-60fd4efed67c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "id": "2", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:29.497375 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-c0425ecf-d4cf-4ff5-b15f-60fd4efed67c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082321 Jun 15 10:24:29.497934 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:29.511881 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-232d9607-3a61-4758-a718-c2e46f595c42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:29.535656 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-232d9607-3a61-4758-a718-c2e46f595c42 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027327 Jun 15 10:24:29.536259 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jun 15 10:24:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:32.286593 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-c0425ecf-d4cf-4ff5-b15f-60fd4efed67c admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:32.287669 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-c0425ecf-d4cf-4ff5-b15f-60fd4efed67c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 15 10:24:32.288074 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:32.349768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-e998c5af-b197-4d0d-b706-b25e7be2f405 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:32.368173 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-e998c5af-b197-4d0d-b706-b25e7be2f405 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074150 Jun 15 10:24:32.368726 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:32.380256 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-5be04008-eae7-49b3-acf6-441289065b44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:32.401932 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-5be04008-eae7-49b3-acf6-441289065b44 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025241 Jun 15 10:24:32.402499 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jun 15 10:24:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:34.560482 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-e998c5af-b197-4d0d-b706-b25e7be2f405 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:34.562026 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-e998c5af-b197-4d0d-b706-b25e7be2f405 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 15 10:24:34.562439 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:34.622517 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-8f3ab06f-26df-45ee-87aa-88748a9588f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "name": "m1.large"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:34.642316 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-8f3ab06f-26df-45ee-87aa-88748a9588f0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073209 Jun 15 10:24:34.642874 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:34.654537 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-d0545901-70a6-461b-b86a-b7bb23cd8758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:34.678163 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-d0545901-70a6-461b-b86a-b7bb23cd8758 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027155 Jun 15 10:24:34.678822 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jun 15 10:24:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:24:36.864822 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-8f3ab06f-26df-45ee-87aa-88748a9588f0 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:24:36.865830 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-8f3ab06f-26df-45ee-87aa-88748a9588f0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 15 10:24:36.866244 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:24:36.927541 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-710464d1-575c-4f84-87de-fec11940ae3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:36.945917 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-710464d1-575c-4f84-87de-fec11940ae3d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073534 Jun 15 10:24:36.946479 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Wed Jun 15 10:24:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:36.958466 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-84fd52b5-e867-41ae-9199-21cae905940c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:24:36.984016 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-84fd52b5-e867-41ae-9199-21cae905940c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028761 Jun 15 10:24:36.985156 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Wed Jun 15 10:24:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:25:00.660387 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-710464d1-575c-4f84-87de-fec11940ae3d admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:00.661377 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-710464d1-575c-4f84-87de-fec11940ae3d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 15 10:25:00.661769 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:25:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:00.672619 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:00.719683 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-c1dc9a3e-96c9-4de7-a65f-001dbfd91312 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:00.736235 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-c1dc9a3e-96c9-4de7-a65f-001dbfd91312 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068173 Jun 15 10:25:00.736764 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jun 15 10:25:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:01.704699 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-710464d1-575c-4f84-87de-fec11940ae3d admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.705695 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-710464d1-575c-4f84-87de-fec11940ae3d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jun 15 10:25:01.706082 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:01.896623 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-c1a781c8-1195-409f-b3a5-69176729f5d5 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.902195 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.wsgi [None req-c1a781c8-1195-409f-b3a5-69176729f5d5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-c1a781c8-1195-409f-b3a5-69176729f5d5 admin admin] Request method failure captured: Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Accept: application/json Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Accept-Encoding: gzip, deflate Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Connection: keep-alive Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Content-Length: 0 Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Host: 10.222.0.49 Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Openstack-Api-Version: compute 2.90 Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Openstack-System-Scope: None Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: User-Agent: python-novaclient Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Auth-Token: gAAAAABiqbN9xF_YAljU-9jpW6VNfIkQ44CmebDr6RQa6nn4l8jsYoRumsKYV7nADGFxVFoALnnd5Z7HrKLNylYthw4TBr1hsSOEZFAwO0s8nUVQaX3vbR7jiFyWx69WHHfAjWRxd6qg7_OSiansf2zOGXuS_QC3BwUHVPgPnAWSnjYBy8drxl4 Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Domain-Id: None Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Domain-Name: None Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Identity-Status: Confirmed Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Is-Admin-Project: True Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Domain-Id: default Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Domain-Name: Default Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Name: admin Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Role: admin,member,reader Jun 15 10:25:01.905958 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Roles: admin,member,reader Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant: admin Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant-Name: admin Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User: admin Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Domain-Id: default Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Domain-Name: Default Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Id: fcdb2d8e71bd4fe6b9b1431183facba7 Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Name: admin Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: method: > Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: exception: Flavor 42 could not be found. Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: action_args: {'id': '42'} Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:01.907620 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:01.908690 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.910079 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-c1a781c8-1195-409f-b3a5-69176729f5d5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:01.911419 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-c1a781c8-1195-409f-b3a5-69176729f5d5 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061624 Jun 15 10:25:01.911419 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:25:01.917136 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-a0101d80-861a-4d5a-91ec-98c0fc384756 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.920593 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:01.939377 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-a0101d80-861a-4d5a-91ec-98c0fc384756 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025951 Jun 15 10:25:01.939907 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:01.949510 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-054cccc3-da26-4f65-ae01-319d387d10ff admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.971395 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-054cccc3-da26-4f65-ae01-319d387d10ff admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025409 Jun 15 10:25:01.971918 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:25:01.980961 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c71a1974-1f33-42f4-94e5-4ea2d6d3a284 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:01.987153 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.wsgi [None req-c71a1974-1f33-42f4-94e5-4ea2d6d3a284 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c71a1974-1f33-42f4-94e5-4ea2d6d3a284 admin admin] Request method failure captured: Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Accept: application/json Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Accept-Encoding: gzip, deflate Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Connection: keep-alive Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Content-Length: 0 Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Host: 10.222.0.49 Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Openstack-Api-Version: compute 2.90 Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Openstack-System-Scope: None Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: User-Agent: python-novaclient Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Auth-Token: gAAAAABiqbN9xF_YAljU-9jpW6VNfIkQ44CmebDr6RQa6nn4l8jsYoRumsKYV7nADGFxVFoALnnd5Z7HrKLNylYthw4TBr1hsSOEZFAwO0s8nUVQaX3vbR7jiFyWx69WHHfAjWRxd6qg7_OSiansf2zOGXuS_QC3BwUHVPgPnAWSnjYBy8drxl4 Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Domain-Id: None Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Domain-Name: None Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Identity-Status: Confirmed Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Is-Admin-Project: True Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Domain-Id: default Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Domain-Name: Default Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Name: admin Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Role: admin,member,reader Jun 15 10:25:01.990363 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Roles: admin,member,reader Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant: admin Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant-Name: admin Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User: admin Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Domain-Id: default Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Domain-Name: Default Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Id: fcdb2d8e71bd4fe6b9b1431183facba7 Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Name: admin Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: method: > Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: exception: Flavor 42 could not be found. Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: action_args: {'id': '42'} Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:01.991964 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:01.992768 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:01.993781 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c71a1974-1f33-42f4-94e5-4ea2d6d3a284 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:01.994770 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-c71a1974-1f33-42f4-94e5-4ea2d6d3a284 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014357 Jun 15 10:25:01.994770 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jun 15 10:25:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:25:02.861888 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-054cccc3-da26-4f65-ae01-319d387d10ff admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:02.862930 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-054cccc3-da26-4f65-ae01-319d387d10ff admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 15 10:25:02.863361 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:03.052417 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-b2c828c0-0acd-4070-b593-98d04e6fbf07 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.058274 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.wsgi [None req-b2c828c0-0acd-4070-b593-98d04e6fbf07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-b2c828c0-0acd-4070-b593-98d04e6fbf07 admin admin] Request method failure captured: Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Accept: application/json Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Accept-Encoding: gzip, deflate Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Connection: keep-alive Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Content-Length: 0 Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Host: 10.222.0.49 Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Openstack-Api-Version: compute 2.90 Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Openstack-System-Scope: None Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: User-Agent: python-novaclient Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Auth-Token: gAAAAABiqbN-alke75DNYtyjPxygXSj29ZvwL0W0pahFIMAs-eT1ZsGEzez-EVi8f_HpNApgCvmXZWPzPQx7GioUHmklvvU03WY5O0jpfBh_ls6T_OCAwzQUUibLX0VznJmhwvtsAGtzc2kqd4ZiPERCx-Znc6Gp4pFLX54wXvfi57dUojxCpzw Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Domain-Id: None Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Domain-Name: None Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Identity-Status: Confirmed Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Is-Admin-Project: True Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Domain-Id: default Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Domain-Name: Default Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Name: admin Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Role: admin,member,reader Jun 15 10:25:03.059791 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Roles: admin,member,reader Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant: admin Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant-Name: admin Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User: admin Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Domain-Id: default Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Domain-Name: Default Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Id: fcdb2d8e71bd4fe6b9b1431183facba7 Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Name: admin Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: method: > Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: exception: Flavor 84 could not be found. Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: action_args: {'id': '84'} Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:03.061214 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:03.062059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.063177 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-b2c828c0-0acd-4070-b593-98d04e6fbf07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:03.064808 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-b2c828c0-0acd-4070-b593-98d04e6fbf07 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060787 Jun 15 10:25:03.064808 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jun 15 10:25:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:25:03.071585 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-2eb4cd2d-c13c-4c42-b123-27a0e22e75b4 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.086588 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-2eb4cd2d-c13c-4c42-b123-27a0e22e75b4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018495 Jun 15 10:25:03.087136 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jun 15 10:25:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:03.097073 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-123e0d7d-8d71-4c37-9ea1-0d8fb4006658 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.111312 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-123e0d7d-8d71-4c37-9ea1-0d8fb4006658 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017716 Jun 15 10:25:03.111829 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jun 15 10:25:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:03.120772 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-67dc0f8b-a7d3-4106-8757-ff6dc2d5c894 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.126039 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.wsgi [None req-67dc0f8b-a7d3-4106-8757-ff6dc2d5c894 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-67dc0f8b-a7d3-4106-8757-ff6dc2d5c894 admin admin] Request method failure captured: Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Accept: application/json Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Accept-Encoding: gzip, deflate Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Connection: keep-alive Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Content-Length: 0 Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Host: 10.222.0.49 Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Openstack-Api-Version: compute 2.90 Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Openstack-System-Scope: None Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: User-Agent: python-novaclient Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Auth-Token: gAAAAABiqbN-alke75DNYtyjPxygXSj29ZvwL0W0pahFIMAs-eT1ZsGEzez-EVi8f_HpNApgCvmXZWPzPQx7GioUHmklvvU03WY5O0jpfBh_ls6T_OCAwzQUUibLX0VznJmhwvtsAGtzc2kqd4ZiPERCx-Znc6Gp4pFLX54wXvfi57dUojxCpzw Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Domain-Id: None Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Domain-Name: None Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Identity-Status: Confirmed Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Is-Admin-Project: True Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Domain-Id: default Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Domain-Name: Default Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Name: admin Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Role: admin,member,reader Jun 15 10:25:03.127553 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Roles: admin,member,reader Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant: admin Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant-Name: admin Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User: admin Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Domain-Id: default Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Domain-Name: Default Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Id: fcdb2d8e71bd4fe6b9b1431183facba7 Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Name: admin Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: method: > Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: exception: Flavor 84 could not be found. Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: action_args: {'id': '84'} Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:03.129065 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:03.130091 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:03.131412 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-67dc0f8b-a7d3-4106-8757-ff6dc2d5c894 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:03.132668 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-67dc0f8b-a7d3-4106-8757-ff6dc2d5c894 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011604 Jun 15 10:25:03.132668 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Jun 15 10:25:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 10:25:03.989389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-123e0d7d-8d71-4c37-9ea1-0d8fb4006658 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:03.990393 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-123e0d7d-8d71-4c37-9ea1-0d8fb4006658 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 15 10:25:03.990797 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:04.181198 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-48fa9217-202d-4a9d-a100-973c60754635 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:04.187511 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.wsgi [None req-48fa9217-202d-4a9d-a100-973c60754635 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-48fa9217-202d-4a9d-a100-973c60754635 admin admin] Request method failure captured: Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Accept: application/json Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Accept-Encoding: gzip, deflate Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Connection: keep-alive Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Content-Length: 0 Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Host: 10.222.0.49 Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Openstack-Api-Version: compute 2.90 Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Openstack-System-Scope: None Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: User-Agent: python-novaclient Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Auth-Token: gAAAAABiqbN_bK5Xc6EKXSJLdS3_foBNofAOcXhMwSe5hRPypYCo0bp7YBqV9kEo6vLDN2ThlkR_jAKp5syXoiMQHcMsKKD5zlWYrxE1z4x8oeJ-o0KzP3t7HQRVg4WfdVAPbSFKh_4ZnEPkDWUGipFFi3fILMBYJz_Gc0-tRNljEUHa7xCNMw0 Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Domain-Id: None Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Domain-Name: None Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Identity-Status: Confirmed Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Is-Admin-Project: True Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Domain-Id: default Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Domain-Name: Default Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Project-Name: admin Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Role: admin,member,reader Jun 15 10:25:04.188998 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Roles: admin,member,reader Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant: admin Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-Tenant-Name: admin Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User: admin Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Domain-Id: default Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Domain-Name: Default Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Id: fcdb2d8e71bd4fe6b9b1431183facba7 Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: X-User-Name: admin Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: method: > Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: exception: Flavor 451 could not be found. Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: action_args: {'id': '451'} Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:04.190354 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:04.191232 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.192334 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-48fa9217-202d-4a9d-a100-973c60754635 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:04.193330 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-48fa9217-202d-4a9d-a100-973c60754635 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059497 Jun 15 10:25:04.193330 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jun 15 10:25:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:25:04.199971 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-ac38d3d5-27b9-47cd-8769-66b02e7a5772 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:04.215167 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-ac38d3d5-27b9-47cd-8769-66b02e7a5772 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018729 Jun 15 10:25:04.215683 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jun 15 10:25:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:04.224833 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:04.238636 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017320 Jun 15 10:25:04.239174 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Jun 15 10:25:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:25:04.248611 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c8b4ad85-1ad6-4121-b42f-cff8fd157f6a admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:04.253891 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.wsgi [None req-c8b4ad85-1ad6-4121-b42f-cff8fd157f6a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c8b4ad85-1ad6-4121-b42f-cff8fd157f6a admin admin] Request method failure captured: Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Accept: application/json Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Accept-Encoding: gzip, deflate Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Connection: keep-alive Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Content-Length: 0 Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Host: 10.222.0.49 Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Openstack-Api-Version: compute 2.90 Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Openstack-System-Scope: None Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: User-Agent: python-novaclient Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Auth-Token: gAAAAABiqbN_bK5Xc6EKXSJLdS3_foBNofAOcXhMwSe5hRPypYCo0bp7YBqV9kEo6vLDN2ThlkR_jAKp5syXoiMQHcMsKKD5zlWYrxE1z4x8oeJ-o0KzP3t7HQRVg4WfdVAPbSFKh_4ZnEPkDWUGipFFi3fILMBYJz_Gc0-tRNljEUHa7xCNMw0 Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Domain-Id: None Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Domain-Name: None Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Identity-Status: Confirmed Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Is-Admin-Project: True Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Domain-Id: default Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Domain-Name: Default Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Project-Name: admin Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Role: admin,member,reader Jun 15 10:25:04.255389 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Roles: admin,member,reader Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c8da8e1de64f469c9cc5f9a5f416060d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant: admin Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant-Id: c8da8e1de64f469c9cc5f9a5f416060d Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-Tenant-Name: admin Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User: admin Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Domain-Id: default Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Domain-Name: Default Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Id: fcdb2d8e71bd4fe6b9b1431183facba7 Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: X-User-Name: admin Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: method: > Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: exception: Flavor 451 could not be found. Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: action_args: {'id': '451'} Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:25:04.256970 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:04.257818 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: ERROR nova.api.openstack.wsgi Jun 15 10:25:04.258838 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c8b4ad85-1ad6-4121-b42f-cff8fd157f6a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103034) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:25:04.259871 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-c8b4ad85-1ad6-4121-b42f-cff8fd157f6a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012206 Jun 15 10:25:04.259871 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jun 15 10:25:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 10:25:05.113259 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:05.114301 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 15 10:25:05.114706 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:05.303194 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-ca280d77-464f-42b0-a5a5-7b31d71d6645 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:05.321059 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-ca280d77-464f-42b0-a5a5-7b31d71d6645 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069062 Jun 15 10:25:05.321585 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jun 15 10:25:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:25:06.180527 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:06.181556 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 15 10:25:06.181947 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:06.371697 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-26aceb46-2f81-4830-b8cc-a3714a186f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:06.388478 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-26aceb46-2f81-4830-b8cc-a3714a186f2c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068425 Jun 15 10:25:06.389017 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jun 15 10:25:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:25:07.262968 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:07.264041 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 15 10:25:07.264436 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:07.454287 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-451b44aa-2f99-4692-8e35-3e6e679287bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:07.471355 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-451b44aa-2f99-4692-8e35-3e6e679287bb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068341 Jun 15 10:25:07.471891 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jun 15 10:25:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:25:08.340503 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:08.341556 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 15 10:25:08.341930 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:08.529997 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-d68b4a63-c3b0-4f82-86dd-db43d6bdff95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:25:08.547459 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-d68b4a63-c3b0-4f82-86dd-db43d6bdff95 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068368 Jun 15 10:25:08.547976 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Jun 15 10:25:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:25:09.418122 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:09.419141 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 15 10:25:09.420170 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:09.616915 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-ba0baa97-0fa9-44bc-a563-1e30d26c91d7 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:09.635754 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-ba0baa97-0fa9-44bc-a563-1e30d26c91d7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069688 Jun 15 10:25:09.636217 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Jun 15 10:25:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:58.118025 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:58.119027 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-fe67368f-12d7-4c5f-9518-a43ef98613d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 15 10:25:58.119448 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Wed Jun 15 10:25:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:25:58.130151 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:58.177677 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-92527880-62ec-4e09-8ecf-6709c559e826 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:58.196893 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-92527880-62ec-4e09-8ecf-6709c559e826 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071118 Jun 15 10:25:58.197419 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Wed Jun 15 10:25:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:25:58.219995 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-572afadb-59e5-4a5d-bb03-8176853cd715 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:58.223370 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG dbcounter [-] [103033] Writing DB stats nova_api:SELECT=14 {{(pid=103033) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:58.228568 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-572afadb-59e5-4a5d-bb03-8176853cd715 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012604 Jun 15 10:25:58.229081 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Wed Jun 15 10:25:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:58.240608 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-6d59936a-3544-42bd-bd59-585f7304fe37 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:58.248034 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-6d59936a-3544-42bd-bd59-585f7304fe37 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010940 Jun 15 10:25:58.248544 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Wed Jun 15 10:25:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:58.259419 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:58.266903 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010938 Jun 15 10:25:58.267456 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Wed Jun 15 10:25:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:25:58.278131 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-bdb1436b-c532-46d0-ad86-763932cae5ab admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:25:58.285930 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-bdb1436b-c532-46d0-ad86-763932cae5ab admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011221 Jun 15 10:25:58.286588 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Wed Jun 15 10:25:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:29:14.001359 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:14.002395 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 15 10:29:14.002815 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:14.158202 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_api:SELECT=6 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:14.270701 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c22495b9-b8eb-49d4-acad-772a76a76ef6 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:14.271897 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:29:14.271897 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: warnings.warn(msg) Jun 15 10:29:14.273123 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c22495b9-b8eb-49d4-acad-772a76a76ef6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:14.273563 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c22495b9-b8eb-49d4-acad-772a76a76ef6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:14.274350 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c22495b9-b8eb-49d4-acad-772a76a76ef6 admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:14.274779 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c22495b9-b8eb-49d4-acad-772a76a76ef6 admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:14.308053 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-c22495b9-b8eb-49d4-acad-772a76a76ef6 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151362 Jun 15 10:29:14.308617 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jun 15 10:29:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:15.185580 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:15.186592 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 15 10:29:15.186983 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:15.381620 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-c25a670d-c125-477e-8987-e43648ae92b9 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:15.382787 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:29:15.382787 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: warnings.warn(msg) Jun 15 10:29:15.384037 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c25a670d-c125-477e-8987-e43648ae92b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:15.384479 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c25a670d-c125-477e-8987-e43648ae92b9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:15.385267 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c25a670d-c125-477e-8987-e43648ae92b9 admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:15.385698 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-c25a670d-c125-477e-8987-e43648ae92b9 admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:15.405737 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-c25a670d-c125-477e-8987-e43648ae92b9 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077921 Jun 15 10:29:15.406219 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jun 15 10:29:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:29:26.701066 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:26.702075 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 15 10:29:26.702474 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:26.845770 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_cell0:SELECT=4 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:26.846487 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_cell1:SELECT=4 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:26.847111 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG dbcounter [-] [103034] Writing DB stats nova_api:SELECT=8 {{(pid=103034) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:26.894776 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-3ed70aad-0e35-4252-ac28-57dd342d7e7a admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:26.895976 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:29:26.895976 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: warnings.warn(msg) Jun 15 10:29:26.897178 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-3ed70aad-0e35-4252-ac28-57dd342d7e7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:26.897618 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-3ed70aad-0e35-4252-ac28-57dd342d7e7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:26.898402 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-3ed70aad-0e35-4252-ac28-57dd342d7e7a admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:26.898832 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-3ed70aad-0e35-4252-ac28-57dd342d7e7a admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:26.923219 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-3ed70aad-0e35-4252-ac28-57dd342d7e7a admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081719 Jun 15 10:29:26.923869 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jun 15 10:29:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:29:27.783674 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: DEBUG nova.api.openstack.wsgi [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] Calling method '>' {{(pid=103033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:27.784702 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: INFO nova.api.openstack.requestlog [None req-bf9c06ae-b694-4ead-aadb-8ea68827c2a4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 15 10:29:27.785103 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: [pid: 103033|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Jun 15 10:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:29:27.974445 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG nova.api.openstack.wsgi [None req-d710d05e-af05-4ac8-a7c9-f3c15df8cc31 admin admin] Calling method '>' {{(pid=103034) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:29:27.975635 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:29:27.975635 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: warnings.warn(msg) Jun 15 10:29:27.976832 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-d710d05e-af05-4ac8-a7c9-f3c15df8cc31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:27.977325 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-d710d05e-af05-4ac8-a7c9-f3c15df8cc31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:27.978104 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-d710d05e-af05-4ac8-a7c9-f3c15df8cc31 admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:29:27.978525 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: DEBUG oslo_concurrency.lockutils [None req-d710d05e-af05-4ac8-a7c9-f3c15df8cc31 admin admin] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103034) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:29:27.999858 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: INFO nova.api.openstack.requestlog [None req-d710d05e-af05-4ac8-a7c9-f3c15df8cc31 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076950 Jun 15 10:29:28.000334 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: [pid: 103034|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Jun 15 10:29:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:30:26.094546 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: Wed Jun 15 10:30:26 2022 - graceful shutdown triggered... Jun 15 10:30:26.094687 dv-cinder-843493-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 10:30:26.095592 dv-cinder-843493-2-iscsi devstack@n-api.service[103033]: Gracefully killing worker 1 (pid: 103033)... Jun 15 10:30:26.096028 dv-cinder-843493-2-iscsi devstack@n-api.service[103034]: Gracefully killing worker 2 (pid: 103034)... Jun 15 10:30:27.096003 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: worker 1 buried after 1 seconds Jun 15 10:30:27.096003 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: worker 2 buried after 1 seconds Jun 15 10:30:27.096003 dv-cinder-843493-2-iscsi devstack@n-api.service[103032]: goodbye to uWSGI. Jun 15 10:30:27.097455 dv-cinder-843493-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 10:30:27.098005 dv-cinder-843493-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 10:30:27.100781 dv-cinder-843493-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 10:30:27.110852 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:30:27 2022] *** Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: nodename: dv-cinder-843493-2-iscsi Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: machine: x86_64 Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: clock source: unix Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: pcre jit disabled Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: detected number of CPU cores: 4 Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: current working directory: / Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: your processes number limit is 47680 Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: your memory page size is 4096 bytes Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: detected max file descriptor number: 2048 Jun 15 10:30:27.112881 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: lock engine: pthread robust mutexes Jun 15 10:30:27.113758 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: thunder lock: enabled Jun 15 10:30:27.113758 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 10:30:27.113758 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:30:27.157131 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: Python main interpreter initialized at 0x5615e99ee9c0 Jun 15 10:30:27.157131 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: python threads support enabled Jun 15 10:30:27.157131 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: your server socket listen backlog is limited to 100 connections Jun 15 10:30:27.157131 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:30:27.157601 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:30:27.157601 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: *** Operational MODE: preforking *** Jun 15 10:30:27.157854 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:30:27.157854 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: spawned uWSGI master process (pid: 118851) Jun 15 10:30:27.158058 dv-cinder-843493-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 10:30:27.162133 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: spawned uWSGI worker 1 (pid: 118864, cores: 1) Jun 15 10:30:27.162133 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: spawned uWSGI worker 2 (pid: 118865, cores: 1) Jun 15 10:30:27.162133 dv-cinder-843493-2-iscsi devstack@n-api.service[118851]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:30:27.820456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:30:27.822912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 10:30:29.060717 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:30:29.060717 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: from cryptography.utils import int_from_bytes Jun 15 10:30:29.061315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:30:29.061315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: from cryptography.utils import int_from_bytes Jun 15 10:30:29.076148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:30:29.076148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: from cryptography.utils import int_from_bytes Jun 15 10:30:29.076832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:30:29.076832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: from cryptography.utils import int_from_bytes Jun 15 10:30:31.535333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:30:31.535882 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:30:31.536239 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:30:31.536673 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:30:31.536999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:30:31.537452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.537782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.538111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.538428 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.538763 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.539070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.539420 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.539741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.540073 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.540339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.540658 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.540987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-2-iscsi {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.541313 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.541660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.541978 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.542301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.542613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.542940 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.543277 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.543778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.544507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.544820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.545232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.545580 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.545899 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.546227 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.546542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.546862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.547210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.547742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.547994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-2-iscsi {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.548322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.549283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.549283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.549502 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.549734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.550051 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.550377 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.550715 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.551029 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.551386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.551708 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.552034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.552357 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.552663 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.552988 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.553295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.553619 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.553927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.554236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.554490 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.554985 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.555333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.555649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.555974 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.556233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.556662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.557213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.557733 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.558061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.558376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.558691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.559006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.559359 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.559652 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.559963 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.560278 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.560599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.560917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.561245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.561556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.561879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.562284 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.562542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.562854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.563221 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.563550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.563920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.564184 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.564512 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.564820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.565128 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.565456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.565759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.566104 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.566407 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.566662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.566965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.567303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.567630 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.567939 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.568250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.568562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.568868 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.569181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.569494 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.569801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.570113 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.570422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.570731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.571040 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.571622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.571933 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.572256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.572583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.573423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.573737 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.574048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.574361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.574682 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.574993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.575332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.575657 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.575965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.576273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.576602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.576909 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.577219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.577541 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.577846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.578155 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.578476 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.578852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.584376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.585081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.585701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.585701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.585701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.585701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.585701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.586081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.586081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.586379 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.586742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.587260 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.587814 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.588309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.589538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.589880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.590203 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.590535 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.590843 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.591181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.591510 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.591920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.592495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.592621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.593249 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.593810 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.594304 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.594802 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.595165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.595491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.595812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.596123 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.596542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.596937 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.597275 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.597686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.598241 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.598790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.598790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.599122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.599482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.599871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.600244 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.600581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.600867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.601194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.601548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.601861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.602179 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.602486 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.602791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.603114 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.603434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.603740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.604064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.604427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.604740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.605080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.605386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.605698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.606006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.606316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.606625 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.606957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.607274 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.607583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.607921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.608232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.608539 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.608859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.609170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.609470 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.609959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.610427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.610922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.611273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.611584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.611997 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.612213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.612532 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.612869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.613202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.613507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.613829 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.614335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.614788 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.614955 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.615462 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.615774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.616080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.616386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.616734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.617048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.617357 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.617662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.617873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:30:31.618341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.618514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:30:31.618754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.618754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.619064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:30:31.619466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.620498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:30:31.620658 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.620829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:30:31.621075 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.621240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.621384 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.621525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.621689 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.622366 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.622530 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.622691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.622847 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.623000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.623408 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.623559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.623728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.623728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.623994 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.624105 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.624273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.624472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.624641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.624641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.625105 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.625370 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.625645 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.625790 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843493-2-iscsi {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.625944 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.626120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.626263 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.626414 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.626564 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.626721 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.626870 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.627012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.627197 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.627342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.627496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.627648 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.627790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.627986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.628133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.628133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.628495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.628672 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.629059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.629218 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.629361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.629502 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.629660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.629660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.629964 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.630124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.630265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.630406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.630692 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.630692 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.631247 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.631247 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.631537 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.631682 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.631836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.631836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.632112 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.632253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.632500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843493-2-iscsi {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.632658 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.632871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.633017 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.633144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.633268 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.633436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.633669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.633669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.634073 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.634228 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.634388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.634518 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.634662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.634880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.635027 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.635874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.635874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.636368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.636515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.636650 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.636793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.636932 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.637060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.637186 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.637322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.637450 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.637585 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.637719 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.637854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.637990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.638127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.638262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.638396 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.638524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.638672 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.638901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.639138 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.639467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.639599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.639740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.639869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.640010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.640145 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.640273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.640408 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.640534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.640675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.640882 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.641012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.641148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.641373 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.641504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.641641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.641782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.641911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.642045 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.642288 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.642427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.642644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.642785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.642920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.643048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.643222 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.643335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.643484 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.643613 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.644080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.644230 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.644356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.644473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.644596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.644923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.645033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.645149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.645414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.645541 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.645679 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.645808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.645942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.648154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.648306 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.648453 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.648584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.648712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.648863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.648863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.648863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.648863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.649526 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.649668 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.649810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.649950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.650092 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.650251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.650393 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.650544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.650696 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.650855 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.651739 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.651983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.651983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.651983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.651983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.652527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.653747 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.653905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.654071 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.654322 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.654322 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.654611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.654611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.654933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.655110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.655260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.655564 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.655719 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.655904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.656049 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.656200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.656342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.656342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.656621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.656763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.656948 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.657094 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.657235 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.657389 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.657531 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.657672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.657672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.657946 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.658122 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.658367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.658523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.658672 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.658822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.658999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.659184 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.659676 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.659834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.659834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.659834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.659834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.659834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.659834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.660679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.660679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.660679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.661190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.661345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.661496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.661646 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.661796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.661961 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.662179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.662179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.662486 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.662629 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.662796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.663016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.663246 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.663408 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.663617 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.663763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.663912 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.664061 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.664203 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.664374 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.664609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.664775 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.664926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.665069 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.665210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.665402 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.665696 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.665852 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.665852 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.666128 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.666269 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.666484 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.666666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.666821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.666974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.667156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.667313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.667488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.667755 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.667904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.668046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.668188 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.668365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:30:31.668591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.668737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.668886 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.669047 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.669203 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.669558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.669883 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.670626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.670792 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.670937 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.671123 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.671440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.671601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.671746 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.671887 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.672036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.672225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.672454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.672603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.672949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.673201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.675279 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.675468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.675771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.675927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676072 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676521 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.676969 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.677110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.677260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.677413 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.677561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.677710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.677974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.678130 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.678287 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.678429 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.678605 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.678878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.679035 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.679212 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.680308 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.680468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.680626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.680772 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.680915 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.681065 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.681216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.681430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.682580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.682761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.682972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.683169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.683402 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.683564 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.683707 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.683849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.683990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.684146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.684297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.684439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.684580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.684728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.684950 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.685122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.685273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.685519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.685666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.685986 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686570 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686718 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.686859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.687175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.688315 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.688476 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.688630 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.688773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689026 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689182 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689477 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689760 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.689914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.690073 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.690223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.690366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.690516 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.690516 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.693891 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.694108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.694273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.694422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.694575 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.694727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.694880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.695030 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.695213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.695368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.695538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.695789 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.696129 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.696129 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.696415 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.696564 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.696722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.696879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.697039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.697231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.697378 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.697530 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.699442 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.699627 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.699785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.699932 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700517 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700668 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.700999 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.701142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.701311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.701311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.701582 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.701731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.701881 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.702025 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.702175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.702317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.702458 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.702600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.702908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.703059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.703059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.703393 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.703542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.703542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.703926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704235 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704377 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704661 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704810 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.704977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705128 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.705726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.706735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.706735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707497 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.707944 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.708094 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.708237 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.708386 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.708529 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.708684 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.708869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.709031 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.709199 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.709496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.709666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.709827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.709827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710139 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710295 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.710987 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.711253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.711403 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.711545 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.711545 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.711837 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.711986 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.712136 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.712136 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.712764 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.713078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.713237 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.713383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.713598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.713764 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714519 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714804 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.714967 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715278 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715719 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.715875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.716416 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.716566 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.716708 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.716860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717324 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717466 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717607 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.717910 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718061 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718204 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.718947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.719277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.720538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.720679 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.720822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.720971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.721121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.721121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.721475 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.721618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.721766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.721909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722362 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722503 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722652 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722794 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.722936 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.723263 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.723414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.723571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.723726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.723869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.724110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.724259 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.724412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.724555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.724704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.724854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.725984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.726146 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.726550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.726708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.726859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727011 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.727903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728051 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.728653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.729872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730188 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.730922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735460 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735655 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735847 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.735945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736554 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736726 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.736916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737328 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737521 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737703 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.737965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738312 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738312 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738565 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738839 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.738932 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.739019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.739173 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.739271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.739271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.739271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.739271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.740824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.740824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.741025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.741142 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.741239 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.741326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.741419 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.741628 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.742067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.742498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.742956 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.743491 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.743729 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.744158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.744326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.744866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.745289 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.745523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.745793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.746212 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.746378 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.746712 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.747021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.747507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.747673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.748149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.748319 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.748789 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.749275 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.749764 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.750277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.750584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.750923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.751168 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.751583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.751704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.752111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.752315 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.752656 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.752935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.753356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.753777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.754179 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.754400 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.754816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.755028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.755366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.755721 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.755832 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.756284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.756394 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.756820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.756997 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.757473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.757584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.758038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.758172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.758601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.758773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.759163 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.759431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.759668 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.760058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.760894 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.761364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.761528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.761896 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.762191 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.762409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.762847 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.763044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.763464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.763702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.764159 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.764325 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.764791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.764933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.765289 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.765542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.765848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.766198 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.766309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.766764 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.766892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.767417 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.767528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.767929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.768159 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.768604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.768824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.769112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.769445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.769639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.770066 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.770204 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.770675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.770891 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.771392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.771575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.771902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.772206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.772411 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.772836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.772953 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.773406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.773527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.773947 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.774177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.774637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.774763 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.775262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.775372 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.775787 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.776029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.777004 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.777189 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.777636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.777849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.778259 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.778378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.778836 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.778948 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.779391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.779575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.779900 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.780204 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.780668 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.781115 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.781578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.782041 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.782489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.782962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.783073 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.783563 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.783671 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.784108 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.784271 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.784988 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.785224 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.785610 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.785729 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.786175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.786283 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.786696 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.786868 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.787250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.787520 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.788075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.788612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.789118 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.789244 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.789674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.789872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.790197 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.790631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.791472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.791711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.792172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.792796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.793853 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.794279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.794965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.795522 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.795957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.796385 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.796817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.797258 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.799063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.799412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.799914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.800297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.800777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.800903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.801238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.801756 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.801756 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.802818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.802941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.803054 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.803186 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.804143 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.804258 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.804349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.804349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.804525 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.804850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.805190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.805583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.806068 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.806191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.806587 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.806861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.807193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.807568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.807738 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.808177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.808360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.808711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.809015 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.809280 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.809651 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.809831 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.810404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.810539 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.810904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.811226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.811441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.811862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.812005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.812359 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.812625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.812990 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.813265 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.813504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.813886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.814226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.814547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.814747 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.815218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.815563 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.815905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.816317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.816536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.816748 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.816873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817073 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817884 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.817984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.818217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.818316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.818543 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.818662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.818867 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.818972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.819220 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.819386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.819575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.819912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.820217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.820519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.820672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.821006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.821312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.821437 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.821645 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.821743 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.821952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.822273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.822372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.822591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.822698 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.824575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.824685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.824776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.824776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.824926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825008 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825246 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825328 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825436 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.825762 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.826112 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.826443 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.826769 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.826886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.827119 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.827431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.827709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.827833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.828042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.828351 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.828608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.828720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.828966 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.829279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.829486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.829604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.829890 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.830210 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.830412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.830737 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.831119 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.831229 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.831438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.831747 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.832034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.832155 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.832358 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.832668 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.832926 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.833045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.833292 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.833604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.833798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.834283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.834404 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.834608 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.835007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.835294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.835683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.835794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.836160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.836396 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.836520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.836821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.837131 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.837422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.837540 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.837733 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.838060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.838301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.838410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.838741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.839055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.839226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.839407 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.839719 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.839989 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.840099 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.840561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.840706 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.840901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.841216 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.841529 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.841664 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.841840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.842175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.842812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.842912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.843269 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.843598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.843712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.844038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.844620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.844805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.844952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.845276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.845599 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.845927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.846253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.846381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.846576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.846892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.847174 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.847282 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.847552 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.847865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.848052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.848193 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.848627 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.848790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.848943 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.849262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.849559 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.849746 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.850069 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.850294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.850475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.850815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.851300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.851424 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.851637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.851951 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.852171 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.852286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.852572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.852904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.853099 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.853365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.853698 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.853951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.854071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.854355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.854689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.855020 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.855581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.856146 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.856397 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.856621 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.856981 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.857338 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.857685 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.857991 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.858121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.858331 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.858433 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.858669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.858767 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.859006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.859133 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.859403 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.859496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.859723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.859827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.860076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.860193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.860345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.860454 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.860681 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.860819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.861033 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.861543 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.861864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.862180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.862491 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.862814 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.862993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.863213 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.863418 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.863583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.863744 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.863897 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.864049 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.864200 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.864456 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.864613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.864787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.865078 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.865236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.865412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.865585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.865745 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.866019 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.866326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.866637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.866984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.867344 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.867673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868196 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868502 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868826 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.868987 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.869148 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.869301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.869533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.870219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.870383 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.870544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.870704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.870870 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.871036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.871511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.871674 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.871836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.871996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872470 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872624 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872624 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872913 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.872913 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.873234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.873392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.873544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.873695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.873854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874022 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874182 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874651 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.874999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.875197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.875364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.875515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.875665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.875817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.875979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.876139 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.876291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.876456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.876608 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.876766 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.876928 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.877080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.877249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.877402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.877553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.877714 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.877866 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.878069 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.878236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.878389 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.878547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.878709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.878862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.879022 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.879371 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.879547 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.880307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.880514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.880682 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.881041 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.881201 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.881354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.882233 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.882403 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.882576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.882576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.882886 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.883077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.883293 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.883461 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.883461 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.883760 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.883912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.884078 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.884231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.884231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.884231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.884696 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.884845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.885189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.885500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.885952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.886208 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.886582 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.886736 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.887945 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.888120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.888120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.888427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.888592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.888592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.888968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.889150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.889306 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.889467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.889632 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.889785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.889935 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.890151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.890151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.890479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.890479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.890780 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.891327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.891750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.891969 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.892225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.892415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.893024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.893024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.893347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.893716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.893900 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.894055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.894239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.894462 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.894616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.894844 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.894994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.895232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.895655 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.896153 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.896730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.897361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.897739 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.898125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.898626 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.898804 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.898957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.899215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.899365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.899541 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.899708 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:30:31.899887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.900102 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.900643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.901532 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.902786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.903294 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.903613 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.903955 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.905558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.905910 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.906227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.908990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.909343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.909980 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.910451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.910828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.911199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.911536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.911974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.912221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.912490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.912816 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.913136 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.913452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.913784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.914103 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.914417 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.914747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.915064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.915677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.918770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.919826 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.919826 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.919826 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.920111 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.920494 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.920815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.921144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.921454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.921770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.922147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.922419 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.923528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.923878 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.924223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.924568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.924900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.925233 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.925561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.925914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.926270 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.926593 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.926915 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.927362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.927765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.928163 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.928846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.929213 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.929554 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.929872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.930212 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.930568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.930889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.931246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.931580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.931892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.932313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.932641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.933215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.933566 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.933895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.934238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.934595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.934895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.935276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.935611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.935949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.936271 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.936589 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.936908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.937226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.937544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.937863 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.938178 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.938606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.939248 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.939550 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.940551 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.940871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.941194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.941519 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.941873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.943319 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.943665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.944003 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.944340 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.944671 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.944997 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.945322 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.945647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.945985 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.946316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.946641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.946955 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.947443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.947751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.948137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.948499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.948952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.949293 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.950100 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.950436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.950779 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.951123 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.951466 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.951815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.952162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.952496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.952811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.953126 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.953446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.953753 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.954078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.954396 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.954708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.955017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.955583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.955900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.956213 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.956527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.956838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.957151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.957461 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.957773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.958084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.958395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.958707 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.961023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.961378 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.961702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.962053 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.962363 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.962687 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.963031 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.963955 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.964333 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.965438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.965792 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.966127 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.966467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.966794 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.967158 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.967500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.967829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.968151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.968493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.968815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.969251 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.969584 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.970137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.970242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.970612 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.970886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.971254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.971571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.971806 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO dbcounter [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Registered counter for database nova_api Jun 15 10:30:31.972016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.972310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.972743 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.973021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.973342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.973683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.974002 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.974316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.974638 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.974962 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.975304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.975627 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.975951 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.976289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.976628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.976944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.977706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.977706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.977947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.978262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.978620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.978954 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.980000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.980328 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.980643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:30:31.980894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:30:31.995079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.003382 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writer thread running {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.046150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO dbcounter [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Registered counter for database nova_api Jun 15 10:30:32.063560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.context [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed046e13-dc35-409c-a39d-d673ce8dff73(cell1) {{(pid=118865) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:30:32.066516 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.068252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.069850 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.070642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.072649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.073806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writer thread running {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.074879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO dbcounter [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Registered counter for database nova_cell0 Jun 15 10:30:32.078840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO dbcounter [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Registered counter for database nova_cell1 Jun 15 10:30:32.086857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.092455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writer thread running {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.093117 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.132144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.context [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed046e13-dc35-409c-a39d-d673ce8dff73(cell1) {{(pid=118864) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 10:30:32.136387 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.137982 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.138774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:30:32.140771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:30:32.142796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO dbcounter [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Registered counter for database nova_cell0 Jun 15 10:30:32.146726 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO dbcounter [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Registered counter for database nova_cell1 Jun 15 10:30:32.154914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.159041 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.161124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writer thread running {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.238318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writer thread running {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.247629 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO dbcounter [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Registered counter for database nova_cell0 Jun 15 10:30:32.254906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_db.sqlalchemy.engines [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.259688 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writer thread running {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.307634 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writer thread running {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.317850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO dbcounter [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Registered counter for database nova_cell0 Jun 15 10:30:32.325824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:30:32.331624 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writer thread running {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:30:32.585772 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: WARNING keystonemiddleware.auth_token [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:30:32.596461 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: WARNING keystonemiddleware.auth_token [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:30:32.682790 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: WARNING keystonemiddleware.auth_token [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:30:32.692658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: WARNING keystonemiddleware.auth_token [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:30:32.990547 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: WARNING keystonemiddleware.auth_token [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:30:32.996930 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: WARNING keystonemiddleware.auth_token [None req-6b9144ec-34fe-4f81-a39b-636c0b4a291f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:30:33.002553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5615e99ee9c0 pid: 118865 (default app) Jun 15 10:30:33.073514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: WARNING keystonemiddleware.auth_token [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 10:30:33.079692 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: WARNING keystonemiddleware.auth_token [None req-c2b19cb4-3236-41b4-a6cb-698e835653e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 10:30:33.085208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615e99ee9c0 pid: 118864 (default app) Jun 15 10:31:12.996663 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:12.997849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:12.998619 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:12.999670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:15.030225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7d417a18-bab1-4a5c-8e84-fe7b01a87d5f tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Action: 'create', calling method: .version_select at 0x7feb40ae3820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-13024065"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:15.089342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:15.091220 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:15.092170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:15.095562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:16.199749 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1997108520", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "networks": [{"uuid": "9a94a4c7-195b-4de3-a93a-ee4846d90190"}]}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:16.668567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] validate_networks() for [('9a94a4c7-195b-4de3-a93a-ee4846d90190', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:31:17.291500 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7d417a18-bab1-4a5c-8e84-fe7b01a87d5f tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.314120 Jun 15 10:31:17.292746 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1154 bytes} [Wed Jun 15 10:31:12 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4318 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 10:31:17.298922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4dd02e22-94f8-4659-a9e4-053b46c269e6 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb409ac670>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:17.399343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4dd02e22-94f8-4659-a9e4-053b46c269e6 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7b0d249d-aae6-48a0-85bc-e06ec34677d9" status: 200 len: 350 microversion: 2.1 time: 0.103434 Jun 15 10:31:17.401311 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:17 2022] GET /compute/v2.1/os-volumes/7b0d249d-aae6-48a0-85bc-e06ec34677d9 => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:17.412644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f4a6020c-eb39-4d11-b0d1-b3419a5eada1 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb409ac8b0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:17.598147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f4a6020c-eb39-4d11-b0d1-b3419a5eada1 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3" status: 200 len: 343 microversion: 2.1 time: 0.193491 Jun 15 10:31:17.598993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 3/3] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:17 2022] GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 => generated 343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:18.616611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9fd564c1-0ed5-4e45-9d19-7645e2aff6ed tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb409ace50>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:18.700074 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9fd564c1-0ed5-4e45-9d19-7645e2aff6ed tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3" status: 200 len: 344 microversion: 2.1 time: 0.093036 Jun 15 10:31:18.700631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:18 2022] GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:18.712513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-beda88bb-5d33-4acc-bb4d-4dc66cb4f826 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Action: 'create', calling method: .version_select at 0x7feb409c44c0>, body: {"snapshot": {"volume_id": "f55b9c10-7d14-4171-9105-731a030b56c3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-308455066"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:19.045062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-beda88bb-5d33-4acc-bb4d-4dc66cb4f826 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.337038 Jun 15 10:31:19.045996 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 5/5] 10.222.0.49 () {60 vars in 1161 bytes} [Wed Jun 15 10:31:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:19.058803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ec4a25dd-c87b-4116-96b6-e69fef5beecc tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb409acd30>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:19.172685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ec4a25dd-c87b-4116-96b6-e69fef5beecc tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 200 len: 286 microversion: 2.1 time: 0.082431 Jun 15 10:31:19.172685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 6/6] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:19 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:19.172685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-55e4e7e9-c250-4430-8064-6ea119218135 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb409ac940>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:19.238598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-55e4e7e9-c250-4430-8064-6ea119218135 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.097067 Jun 15 10:31:19.239504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 7/7] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jun 15 10:31:19 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:19.245366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ea1aa6d4-3452-4404-b334-7018bc525987 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb409c4160>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:19.368166 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ea1aa6d4-3452-4404-b334-7018bc525987 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9984e1e5-a40a-48e3-b541-a330f71aa994" status: 200 len: 351 microversion: 2.1 time: 0.127343 Jun 15 10:31:19.369930 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 8/8] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:19 2022] GET /compute/v2.1/os-volumes/9984e1e5-a40a-48e3-b541-a330f71aa994 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:19.375151 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-677f208c-a3ff-41a3-8884-0b598b809116 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb409c4820>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:19.637165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-677f208c-a3ff-41a3-8884-0b598b809116 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 200 len: 286 microversion: 2.1 time: 0.265642 Jun 15 10:31:19.641251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 9/9] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:19 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:20.271785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:31:20.272926 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:31:20.273788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:31:20.274149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:31:20.274562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:31:20.329859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:20.334810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:20.335861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:20.336208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:20.416096 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Getting quotas for project b8df5f1986694e8f9ee6f55ef3995621. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:20.432443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Getting quotas for user 38e2794bd474425d9d75f21c1929972b and project b8df5f1986694e8f9ee6f55ef3995621. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:20.467187 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:31:20.471729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:31:20.649759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-504bafdf-10b0-4400-a9ef-f92e57f16444 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb413918b0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:20.655849 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8a8b062b-3512-4655-a8b4-f9850e1f4af2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.572117 Jun 15 10:31:20.661992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 1/10] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 5575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:31:20.668074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8d077f35-567d-4b29-85cd-d95677f0528d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:20.668709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8d077f35-567d-4b29-85cd-d95677f0528d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:20.731387 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-504bafdf-10b0-4400-a9ef-f92e57f16444 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 200 len: 286 microversion: 2.1 time: 0.085981 Jun 15 10:31:20.733503 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 10/11] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:20 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:21.029944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8d077f35-567d-4b29-85cd-d95677f0528d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:21.065156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8d077f35-567d-4b29-85cd-d95677f0528d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1215 microversion: 2.1 time: 0.401538 Jun 15 10:31:21.071438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 2/12] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:20 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:21.751440 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7d468964-fc53-4efc-b40b-8a0a4f456061 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb409ac790>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:21.831211 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7d468964-fc53-4efc-b40b-8a0a4f456061 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 200 len: 286 microversion: 2.1 time: 0.089879 Jun 15 10:31:21.831773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 11/13] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:21 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:22.083022 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d255545e-cf88-4591-b099-28468b9bfa48 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:22.083818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d255545e-cf88-4591-b099-28468b9bfa48 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:22.309913 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d255545e-cf88-4591-b099-28468b9bfa48 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:22.323199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d255545e-cf88-4591-b099-28468b9bfa48 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1215 microversion: 2.1 time: 0.244781 Jun 15 10:31:22.329491 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 3/14] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:22 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:22.843501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d71b5255-8a9b-42cc-8b82-479b28ad0719 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb40099430>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:22.984171 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d71b5255-8a9b-42cc-8b82-479b28ad0719 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 200 len: 287 microversion: 2.1 time: 0.144929 Jun 15 10:31:22.985063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 4/15] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:22 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:23.005935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9e9e04e9-bf3d-4702-9d98-e48c65170340 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb4007f4c0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:23.132724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9e9e04e9-bf3d-4702-9d98-e48c65170340 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 202 len: 0 microversion: 2.1 time: 0.140847 Jun 15 10:31:23.135120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 5/16] 10.222.0.49 () {58 vars in 1253 bytes} [Wed Jun 15 10:31:22 2022] DELETE /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:31:23.143807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b84ea762-4d3a-4c6b-acff-868356cbb6b2 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb4007fb80>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:23.191421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b84ea762-4d3a-4c6b-acff-868356cbb6b2 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 200 len: 286 microversion: 2.1 time: 0.051953 Jun 15 10:31:23.192311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 6/17] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:23 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:23.311140 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1244080342", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:23.345967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:23.346807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:23.356659 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:23.362672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:23.367395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:23.368071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:23.528432 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] validate_networks() for [('5357f5ea-5034-4116-bf4e-1ab906c37c40', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:31:23.689056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:23.729611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-edc66683-d40a-43c0-813a-932ea83ee5b7 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1267 microversion: 2.1 time: 0.387548 Jun 15 10:31:23.730574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 7/18] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:23 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:23.735812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-569973e4-f11e-4f56-81a4-427e82bad1bc tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7991f0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:23.843293 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-569973e4-f11e-4f56-81a4-427e82bad1bc tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/1bc02494-9881-447c-8523-f09251e8e27a" status: 200 len: 351 microversion: 2.1 time: 0.111495 Jun 15 10:31:23.843870 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 8/19] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:23 2022] GET /compute/v2.1/os-volumes/1bc02494-9881-447c-8523-f09251e8e27a => generated 351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:23.863683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-93ba0903-6297-4c03-97fd-3a86281d55ed tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7ad3a0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:24.078832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-93ba0903-6297-4c03-97fd-3a86281d55ed tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226790 Jun 15 10:31:24.083258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 9/20] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Jun 15 10:31:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:24.095470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-87ffeade-eeff-4cec-b492-bc18162a272a tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7adf70>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:24.273920 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-87ffeade-eeff-4cec-b492-bc18162a272a tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.182586 Jun 15 10:31:24.274858 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 10/21] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Jun 15 10:31:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:24.280207 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8093ed7e-e95f-4ff3-9211-fa0a7312a574 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb3b7ad4c0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:24.333731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-8093ed7e-e95f-4ff3-9211-fa0a7312a574 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] HTTP exception thrown: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8093ed7e-e95f-4ff3-9211-fa0a7312a574 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Request method failure captured: Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 HTTP/1.1 Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbTweITwM13R7bRCAf7ZyIQE8Hw5IX2rGPlZJ2hu3TrTjPO3nZM87KUFEbIXOqUvyszLnX9HSpbbxLT7MD56AG-3Al3Cksd383H93NTVZV5tFJA4oW30y1PE7E8yJedmFK7i5fVjxlEEOLRfeOBMK1CwfbqSX8nv4207IHqXblh4sFM Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:31:24.340445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/63632453a279433b97469eac2f27b36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_63632453a279433b97469eac2f27b36a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: a0652c42307246b49ee7728aab8c4ba9 Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'b8068968-ca26-4a53-8773-bdb9d7f8aa73'} Jun 15 10:31:24.341748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. (HTTP 404) (Request-ID: req-901f1a45-62d4-4670-9a34-bdda4a6f44e2) Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.342571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:24.343470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 10:31:24.344405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8093ed7e-e95f-4ff3-9211-fa0a7312a574 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Returning 404 to user: Snapshot b8068968-ca26-4a53-8773-bdb9d7f8aa73 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:24.345317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8093ed7e-e95f-4ff3-9211-fa0a7312a574 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73" status: 404 len: 111 microversion: 2.1 time: 0.065411 Jun 15 10:31:24.346722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 11/22] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:31:24 2022] GET /compute/v2.1/os-snapshots/b8068968-ca26-4a53-8773-bdb9d7f8aa73 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:31:24.354620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-53bcbce3-819f-4018-b789-9c5136bab897 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7addc0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:24.553289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-53bcbce3-819f-4018-b789-9c5136bab897 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.205255 Jun 15 10:31:24.561029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1133 bytes} [Wed Jun 15 10:31:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:24.563568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-00c71cc5-3217-4093-8087-1e6594173e14 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb3b6ffb80>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:24.719894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-00c71cc5-3217-4093-8087-1e6594173e14 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3" status: 202 len: 0 microversion: 2.1 time: 0.164598 Jun 15 10:31:24.720635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 13/24] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:31:24 2022] DELETE /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:31:24.727045 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d27d544a-853e-4b95-842d-961c9a3e0103 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7bc280>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:24.932476 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d27d544a-853e-4b95-842d-961c9a3e0103 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.210527 Jun 15 10:31:24.933334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1166 bytes} [Wed Jun 15 10:31:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:24.944362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8da480a5-cebe-48bf-acc3-8e8540610caa tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb3b7bcf70>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:25.098549 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-8da480a5-cebe-48bf-acc3-8e8540610caa tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] HTTP exception thrown: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8da480a5-cebe-48bf-acc3-8e8540610caa tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Request method failure captured: Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 HTTP/1.1 Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbTweITwM13R7bRCAf7ZyIQE8Hw5IX2rGPlZJ2hu3TrTjPO3nZM87KUFEbIXOqUvyszLnX9HSpbbxLT7MD56AG-3Al3Cksd383H93NTVZV5tFJA4oW30y1PE7E8yJedmFK7i5fVjxlEEOLRfeOBMK1CwfbqSX8nv4207IHqXblh4sFM Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:31:25.101399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/63632453a279433b97469eac2f27b36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_63632453a279433b97469eac2f27b36a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: a0652c42307246b49ee7728aab8c4ba9 Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'f55b9c10-7d14-4171-9105-731a030b56c3'} Jun 15 10:31:25.102446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. (HTTP 404) (Request-ID: req-a19d8122-ba58-4777-abf6-83e1027dcebc) Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:25.103137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:25.103996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:31:25.104840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8da480a5-cebe-48bf-acc3-8e8540610caa tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Returning 404 to user: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8da480a5-cebe-48bf-acc3-8e8540610caa tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3" status: 404 len: 109 microversion: 2.1 time: 0.167390 Jun 15 10:31:25.107524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 15/26] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:24 2022] GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:31:25.117381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:25.130442 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:25.157432 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:25.158051 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:25.159382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:25.163360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:25.642110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:25.662324 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1c741824-5859-4e1f-ab00-e64e1f88a9a2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1273 microversion: 2.1 time: 0.550958 Jun 15 10:31:25.665572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 16/27] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:25 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1273 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:25.677302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-65d900ee-fe4c-4b75-bdcb-fe3cc0f7ce87 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7bc4c0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:25.924584 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-65d900ee-fe4c-4b75-bdcb-fe3cc0f7ce87 tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.256629 Jun 15 10:31:25.925514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 17/28] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Jun 15 10:31:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:25.932141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2a5b2d40-2c1b-4bb6-9dec-e14d6c77f573 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb3b7adaf0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:26.001315 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-2a5b2d40-2c1b-4bb6-9dec-e14d6c77f573 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] HTTP exception thrown: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2a5b2d40-2c1b-4bb6-9dec-e14d6c77f573 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Request method failure captured: Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: DELETE /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 HTTP/1.1 Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbTweITwM13R7bRCAf7ZyIQE8Hw5IX2rGPlZJ2hu3TrTjPO3nZM87KUFEbIXOqUvyszLnX9HSpbbxLT7MD56AG-3Al3Cksd383H93NTVZV5tFJA4oW30y1PE7E8yJedmFK7i5fVjxlEEOLRfeOBMK1CwfbqSX8nv4207IHqXblh4sFM Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:31:26.003774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/63632453a279433b97469eac2f27b36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_63632453a279433b97469eac2f27b36a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: a0652c42307246b49ee7728aab8c4ba9 Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'f55b9c10-7d14-4171-9105-731a030b56c3'} Jun 15 10:31:26.005216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. (HTTP 404) (Request-ID: req-38d9ef8e-3e09-4c7e-8129-39fb987b70a6) Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:26.006067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:31:26.007410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:31:26.008301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2a5b2d40-2c1b-4bb6-9dec-e14d6c77f573 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Returning 404 to user: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2a5b2d40-2c1b-4bb6-9dec-e14d6c77f573 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3" status: 404 len: 109 microversion: 2.1 time: 0.078875 Jun 15 10:31:26.009784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 18/29] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:31:25 2022] DELETE /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:31:26.031591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9740b5ff-a974-48a2-ab0f-c2310c8eeeba tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b6ff820>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:26.399476 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9740b5ff-a974-48a2-ab0f-c2310c8eeeba tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.387357 Jun 15 10:31:26.400064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 19/30] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jun 15 10:31:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:26.405064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-548ca286-a6d0-4508-8a38-227650716b63 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Calling method '.version_select at 0x7feb3b7bc0d0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:26.468083 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-548ca286-a6d0-4508-8a38-227650716b63 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] HTTP exception thrown: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-548ca286-a6d0-4508-8a38-227650716b63 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Request method failure captured: Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 HTTP/1.1 Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbTweITwM13R7bRCAf7ZyIQE8Hw5IX2rGPlZJ2hu3TrTjPO3nZM87KUFEbIXOqUvyszLnX9HSpbbxLT7MD56AG-3Al3Cksd383H93NTVZV5tFJA4oW30y1PE7E8yJedmFK7i5fVjxlEEOLRfeOBMK1CwfbqSX8nv4207IHqXblh4sFM Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:31:26.470871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/63632453a279433b97469eac2f27b36a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_63632453a279433b97469eac2f27b36a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/63632453a279433b97469eac2f27b36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 63632453a279433b97469eac2f27b36a Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-687533094 Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: a0652c42307246b49ee7728aab8c4ba9 Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-687533094-project Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'f55b9c10-7d14-4171-9105-731a030b56c3'} Jun 15 10:31:26.472016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. (HTTP 404) (Request-ID: req-140dfe9c-fcd5-4c64-a97e-4a8c5b5dabc4) Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:26.472774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:26.473645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:31:26.474559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-548ca286-a6d0-4508-8a38-227650716b63 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] Returning 404 to user: Volume f55b9c10-7d14-4171-9105-731a030b56c3 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:26.475568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-548ca286-a6d0-4508-8a38-227650716b63 tempest-VolumesSnapshotsTestJSON-687533094 tempest-VolumesSnapshotsTestJSON-687533094-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3" status: 404 len: 109 microversion: 2.1 time: 0.071544 Jun 15 10:31:26.477443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 20/31] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:26 2022] GET /compute/v2.1/os-volumes/f55b9c10-7d14-4171-9105-731a030b56c3 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:31:26.496533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bef4a165-7408-4b65-8cbd-edfbf1fd8a7a tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b7ad3a0>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:26.925216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bef4a165-7408-4b65-8cbd-edfbf1fd8a7a tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.446589 Jun 15 10:31:26.929933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 21/32] 10.222.0.49 () {58 vars in 1187 bytes} [Wed Jun 15 10:31:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:26.936307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:26.939059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:26.967993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:26.971673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:26.973594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:26.976709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:27.115043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:31:27.116108 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:31:27.116894 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:31:27.117796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:31:27.119590 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:31:27.168954 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:27.176508 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:27.178444 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:27.184461 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:27.240754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:27.264445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-74c16eb2-f41a-4b53-ae4f-f17df12f7132 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1273 microversion: 2.1 time: 0.328662 Jun 15 10:31:27.266240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 22/33] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:26 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:27.285722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-682f720b-d788-4e5c-aff9-21e1f2d3f46e tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] Calling method '.version_select at 0x7feb3b6ffc10>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:27.347808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:27.395643 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for user 6d152f74395c4b6cb889058f612d502f and project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:27.469917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:31:27.487614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:31:27.647076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-682f720b-d788-4e5c-aff9-21e1f2d3f46e tempest-VolumesTestJSON-506983675 tempest-VolumesTestJSON-506983675-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.379580 Jun 15 10:31:27.647908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 23/34] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Jun 15 10:31:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:27.716345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8223e4b5-776e-46ed-8b82-7d2e1131ba3f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.986929 Jun 15 10:31:27.717650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 12/35] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:31:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:31:27.729486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-229b7b4c-0498-49a3-ba71-82970d1228ba tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:27.730315 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-229b7b4c-0498-49a3-ba71-82970d1228ba tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:27.976362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-229b7b4c-0498-49a3-ba71-82970d1228ba tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:27.998360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-229b7b4c-0498-49a3-ba71-82970d1228ba tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1222 microversion: 2.1 time: 0.274065 Jun 15 10:31:28.008161 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 24/36] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:27 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1222 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:28.282703 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:28.284780 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:28.331439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:28.334965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:28.336710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:28.341950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:28.369886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1284237965", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:28.565367 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] validate_networks() for [('5357f5ea-5034-4116-bf4e-1ab906c37c40', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:31:29.939925 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:29.979984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0516d7f4-3d57-4e0d-8a13-0cf5cdf7a951 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 1.701719 Jun 15 10:31:29.983994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 13/37] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:28 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:30.405346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:30.999499 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:31.000112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:31.031767 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.032736 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:31.034355 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:31.035294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:32.144811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:31:32.146162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:31:32.147153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:31:32.148501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:31:32.149164 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:31:32.195732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:32.196057 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:32.212572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:32.213240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:32.339194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:32.354327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for user 6d152f74395c4b6cb889058f612d502f and project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:32.422272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:31:32.429270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:32.429804 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:31:32.441775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-569768f5-7081-43ab-bc6d-0df2e32415b0 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 1.447038 Jun 15 10:31:32.444185 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 14/38] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:30 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:32.671044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-63861d40-47e5-48fe-b757-fd583c98cdcb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.306895 Jun 15 10:31:32.680102 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 25/39] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:31:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 4317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:31:32.686387 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-056d72de-a733-4253-ae7d-0c7638d0709f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:32.687004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-056d72de-a733-4253-ae7d-0c7638d0709f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:32.940713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-056d72de-a733-4253-ae7d-0c7638d0709f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:32.994037 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-056d72de-a733-4253-ae7d-0c7638d0709f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1222 microversion: 2.1 time: 0.308723 Jun 15 10:31:32.999724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 15/40] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:32 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1222 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:33.459465 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:33.460217 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:33.484308 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.485003 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:33.486808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:33.488808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:34.171268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c8b6e50d-f957-480d-b0f5-8eb7311b3344 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Action: 'create', calling method: .version_select at 0x7feb3b6ff790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1101992189", "metadata": {"Type": "work"}}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:35.113631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c8b6e50d-f957-480d-b0f5-8eb7311b3344 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.949679 Jun 15 10:31:35.122097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 26/41] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jun 15 10:31:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1960 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 10:31:35.145113 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:35.146919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:35.166140 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.166590 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.167395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.167827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.270409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:35.286941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-526d8e36-9cc9-4adc-9689-0bfa77685561 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 1.831619 Jun 15 10:31:35.298566 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 16/42] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:33 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:35.897708 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-dc921441-ae40-48dd-9284-cebca89a41b9 req-d86b7519-81c6-49f7-bab0-4b8047df54af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60658ba0-829b-4d71-9227-556791390b26", "tag": "fdbb94bf-b965-46d1-9c94-6a818e605361"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:35.925379 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-dc921441-ae40-48dd-9284-cebca89a41b9 req-d86b7519-81c6-49f7-bab0-4b8047df54af service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.927627 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-dc921441-ae40-48dd-9284-cebca89a41b9 req-d86b7519-81c6-49f7-bab0-4b8047df54af service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.985357 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-dc921441-ae40-48dd-9284-cebca89a41b9 req-d86b7519-81c6-49f7-bab0-4b8047df54af service nova] Creating event network-changed:fdbb94bf-b965-46d1-9c94-6a818e605361 for instance 60658ba0-829b-4d71-9227-556791390b26 on hv-cinder-84349 Jun 15 10:31:35.985923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-dc921441-ae40-48dd-9284-cebca89a41b9 req-d86b7519-81c6-49f7-bab0-4b8047df54af service nova] Acquired lock "compute-rpcapi-router" {{(pid=118865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 10:31:35.994782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.995332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:35.996351 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:35.996926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.020059 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.compute.rpcapi [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 10:31:36.021141 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 10:31:36.059281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-97e80c37-e108-4f9e-92b8-da68e0f5d0b2 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.748393 Jun 15 10:31:36.060368 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 17/43] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:36.066529 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-60cc036a-99d8-499e-8b3d-38158b0555f9 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Calling method '.version_select at 0x7feb3b7be3a0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.122641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:36.136066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c550ba34-b8d8-4255-a7f5-852c816cceb7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1282 microversion: 2.1 time: 1.012092 Jun 15 10:31:36.136673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 27/44] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:35 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1282 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:36.229861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-60cc036a-99d8-499e-8b3d-38158b0555f9 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f" status: 200 len: 354 microversion: 2.1 time: 0.168074 Jun 15 10:31:36.230945 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 18/45] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f => generated 354 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:36.241636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c1dbf1d9-3009-4e92-91c2-73b0225464c1 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Calling method '.version_select at 0x7feb3b79ac10>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.336469 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e4058126-900e-4bec-b494-a43907593511 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: .version_select at 0x7feb3b7adb80>, body: {"keypair": {"name": "tempest-keypair-690229438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf1nmAL54UmMIvsjxxEDU3vJqGesGYa1S2CvDmUxod4cyuHaQK78iAhMRhQVZS2arwWI8iEjv+6h3mZJsOKI6GitB9J77CZ1ty7p33dPMauCIIUzm5YyvSxHXGBQgeYfQ=="}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:36.369432 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c1dbf1d9-3009-4e92-91c2-73b0225464c1 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f" status: 200 len: 354 microversion: 2.1 time: 0.128660 Jun 15 10:31:36.371161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 19/46] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:36.376513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.377801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:36.395063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-e4058126-900e-4bec-b494-a43907593511 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:36.398125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.398959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.401151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-e4058126-900e-4bec-b494-a43907593511 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:36.405370 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:36.407468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:36.517212 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e4058126-900e-4bec-b494-a43907593511 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.379440 Jun 15 10:31:36.523656 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 28/47] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:31:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:36.532262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dc55cdb2-b16c-4456-b7c6-9e2ee70c9760 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Calling method '.version_select at 0x7feb3b7ade50>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.705940 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dc55cdb2-b16c-4456-b7c6-9e2ee70c9760 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f" status: 202 len: 0 microversion: 2.1 time: 0.181035 Jun 15 10:31:36.706525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 29/48] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:31:36 2022] DELETE /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:31:36.714757 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e8bdb2ce-c6e7-4f87-b916-918c15de5645 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Calling method '.version_select at 0x7feb3b730f70>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:36.822381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e8bdb2ce-c6e7-4f87-b916-918c15de5645 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f" status: 200 len: 353 microversion: 2.1 time: 0.111527 Jun 15 10:31:36.822958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 30/49] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:37.044691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d9d0f2e5-4b74-4b73-a40c-a24dded5b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'create', calling method: .version_select at 0x7feb3b730820>, body: {"keypair": {"name": "tempest-keypair-1617120641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABvgzhEpMOvEibtnwP5NXzNiGso0uFlPIUZc601Coc32xEBqlEU8A21iLcrdXTIzc7x5fLUxuGY34v6mpol1dGNh+6EeWZ5qd4IppllqvXF6Q9aEGPNE7jmWKRF2wbJSQ=="}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:37.074275 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-d9d0f2e5-4b74-4b73-a40c-a24dded5b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for project 5dc28af73e82414d8f709e447286a962. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:37.089670 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-d9d0f2e5-4b74-4b73-a40c-a24dded5b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for user cca7cb5e7620446ebae91b1fe12bbd24 and project 5dc28af73e82414d8f709e447286a962. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:37.172623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d9d0f2e5-4b74-4b73-a40c-a24dded5b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.250009 Jun 15 10:31:37.174117 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 31/50] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jun 15 10:31:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 252 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 15 10:31:37.179499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:37.183345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:37.204165 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.204631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.213200 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:37.213878 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:37.384660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:37.405972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e10060fd-9ea7-441f-a3d1-0cfa51817300 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1280 microversion: 2.1 time: 0.230634 Jun 15 10:31:37.407697 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 32/51] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:37 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:37.834909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9c24502a-5672-4624-9f9f-95cdda5d4009 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Calling method '.version_select at 0x7feb3b737430>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:37.880524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-9c24502a-5672-4624-9f9f-95cdda5d4009 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] HTTP exception thrown: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9c24502a-5672-4624-9f9f-95cdda5d4009 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Request method failure captured: Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f HTTP/1.1 Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUE7076D3iYS9CmtqS6k_QR2n2lkNIZv2OKFk-EEoaisnJMMQ9lsHeK-r-THXUPNIEE1dXVLjE8zHa-FffzMtT05s9NjV02UCp3qlO4v6aCdi5vz6lkr6iIIdpq4JFSKzRaj1HMyXGA8aZQUVZZoS603pYmpNpJ4kNkV7g5Zr47taY Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 6a7f760928d048fd8d39c90c7796515d Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesGetTestJSON-1212690865 Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:31:37.882592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a7f760928d048fd8d39c90c7796515d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7f760928d048fd8d39c90c7796515d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a7f760928d048fd8d39c90c7796515d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7f760928d048fd8d39c90c7796515d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesGetTestJSON-1212690865 Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 6a7f760928d048fd8d39c90c7796515d Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesGetTestJSON-1212690865 Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesGetTestJSON-1212690865-project Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 5a4b9994ac914cbcab64e37132baac9a Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesGetTestJSON-1212690865-project Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '0127fc30-fb41-4925-be99-9815627ae76f'} Jun 15 10:31:37.884050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. (HTTP 404) (Request-ID: req-69cf271f-f3a1-4d9d-be86-9daeabbb2540) Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:37.884890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:31:37.886084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:31:37.887276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. Jun 15 10:31:37.888385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:31:37.889600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9c24502a-5672-4624-9f9f-95cdda5d4009 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] Returning 404 to user: Volume 0127fc30-fb41-4925-be99-9815627ae76f could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:31:37.890256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9c24502a-5672-4624-9f9f-95cdda5d4009 tempest-VolumesGetTestJSON-1212690865 tempest-VolumesGetTestJSON-1212690865-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f" status: 404 len: 109 microversion: 2.1 time: 0.059253 Jun 15 10:31:37.891704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 33/52] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:31:37 2022] GET /compute/v2.1/os-volumes/0127fc30-fb41-4925-be99-9815627ae76f => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:31:38.424447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:38.425873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:38.435027 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:38.445959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-63d239e9-b47e-4839-8e0a-572741b5138d tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 2.071702 Jun 15 10:31:38.447317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 20/53] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:36 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:38.448289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:38.449347 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:38.453457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:38.455459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:38.948938 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:38.960774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-963c61b8-c2ef-46d2-b922-14d3452431e2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1280 microversion: 2.1 time: 0.540135 Jun 15 10:31:38.976505 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 34/54] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:38 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1280 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:39.468356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:39.469129 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:39.488836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.490798 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.494448 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:39.495842 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:39.990249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:39.991537 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:40.004657 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.007753 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.010495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:40.012543 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:40.545163 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:40.560275 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-438cb4a6-8ad9-4179-8e99-8067bc3c9888 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1280 microversion: 2.1 time: 0.579648 Jun 15 10:31:40.560860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 35/55] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:39 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1280 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:41.041628 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:41.058839 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1a301a1d-576f-430e-bcf8-9ab5d0f32007 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 1.597209 Jun 15 10:31:41.064314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 21/56] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:39 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:41.585788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:41.586415 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:41.592857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.593350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:41.601722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:41.604897 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.080106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:42.081955 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:42.091003 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.091500 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.097052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:42.097769 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:42.276714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:42.612225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:42.612699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:42.627937 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-51615bfa-d635-4a53-ad4e-7890cba68909 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 1.050980 Jun 15 10:31:42.630175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0417ca92-0862-4805-bae7-6b85b67f6328 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.555232 Jun 15 10:31:42.631075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 36/57] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:41 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:42.637849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 22/58] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:42 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:43.648016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:43.648756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:43.656354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:43.660545 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:43.662872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.663391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.664214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.665194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.686593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=8 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:43.688710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.695021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:43.699971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:43.701179 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.623741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:44.644669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6dfdfa65-b071-467f-93be-c0798a813feb tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.991879 Jun 15 10:31:44.660349 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 23/59] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:43 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:44.689626 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-1b0f5ae2-0625-4ff9-ab35-3681517743d6 req-81523627-3e79-4991-8fd4-65e658f895d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30aa81b-0ccd-437d-b0dc-401f2ba90533", "tag": "0e9fd3cd-585e-471d-9874-b29128afe6b7"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:44.710765 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1b0f5ae2-0625-4ff9-ab35-3681517743d6 req-81523627-3e79-4991-8fd4-65e658f895d4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:44.711269 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1b0f5ae2-0625-4ff9-ab35-3681517743d6 req-81523627-3e79-4991-8fd4-65e658f895d4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:44.767967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:44.776076 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-1b0f5ae2-0625-4ff9-ab35-3681517743d6 req-81523627-3e79-4991-8fd4-65e658f895d4 service nova] Creating event network-changed:0e9fd3cd-585e-471d-9874-b29128afe6b7 for instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 on hv-cinder-84349 Jun 15 10:31:44.781761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-40d6f25c-5295-40d7-bf75-f298dcffc88e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 1.138016 Jun 15 10:31:44.784417 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 37/60] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:43 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:44.787465 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-1b0f5ae2-0625-4ff9-ab35-3681517743d6 req-81523627-3e79-4991-8fd4-65e658f895d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118963 Jun 15 10:31:44.795687 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-145383967", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56f473a9-939b-4bd2-a5d0-e5eaaaa25745"}], "security_groups": [{"name": "tempest-securitygroup--2073065033"}], "key_name": "tempest-keypair-690229438", "user_data": "}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:44.798664 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 24/61] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:45.081558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] validate_networks() for [('56f473a9-939b-4bd2-a5d0-e5eaaaa25745', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:31:45.672026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:45.673528 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:45.694603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.700125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.701118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:45.703315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:45.811841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:45.997363 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:46.005967 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-45d9a1a3-79dc-4b04-8847-c8cc3ebef807 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.346535 Jun 15 10:31:46.007017 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 25/62] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:45 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:46.013950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=4 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:46.019817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:46.020716 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:46.028789 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.029406 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.030279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.030805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.171488 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:31:46.172079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:31:46.172555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:31:46.172964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:31:46.173640 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:31:46.183311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=27 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:46.184986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.185846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.186918 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.187646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.197864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=59 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:46.207960 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:46.209149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:46.217540 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-99afeec3-23bf-4591-a602-b30fb807ad0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.209119 Jun 15 10:31:46.217999 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:46.218879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 26/63] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:46 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:46.225967 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1869076846", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5f07d8-adfa-49e4-965f-88f44de7cd54"}], "security_groups": [{"name": "tempest-securitygroup--220918986"}], "key_name": "tempest-keypair-1617120641", "user_data": "}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:46.239412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:31:46.241532 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:31:46.327658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0e767fd2-64f9-445e-bfaf-c2ddc80c7707 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.537619 Jun 15 10:31:46.352997 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 38/64] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:31:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:31:46.357820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9caa3865-d46c-448d-a6ad-249382ed3ef0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:46.358345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9caa3865-d46c-448d-a6ad-249382ed3ef0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:46.441392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9caa3865-d46c-448d-a6ad-249382ed3ef0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:46.454223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9caa3865-d46c-448d-a6ad-249382ed3ef0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1240 microversion: 2.1 time: 0.099857 Jun 15 10:31:46.464411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 39/65] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:46 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:46.485740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] validate_networks() for [('4d5f07d8-adfa-49e4-965f-88f44de7cd54', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:31:46.952064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:31:46.952704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:31:46.953184 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:31:46.954163 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:31:46.954665 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:31:46.965770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.966533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.967572 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:46.968085 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:46.987676 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for project 5dc28af73e82414d8f709e447286a962. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:31:46.991998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for user cca7cb5e7620446ebae91b1fe12bbd24 and project 5dc28af73e82414d8f709e447286a962. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:31:47.005095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:31:47.007647 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:31:47.025978 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-504ed660-a20d-4ced-b35e-5243f88eefd6 req-7dccd582-e2dc-4b61-8506-2041a9d28f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe2cfb9-3db4-4587-b3d8-441ba2bf145f", "tag": "8d18190d-8f93-467b-a941-b38fe1222aae"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:47.045702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-504ed660-a20d-4ced-b35e-5243f88eefd6 req-7dccd582-e2dc-4b61-8506-2041a9d28f4a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.047772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-504ed660-a20d-4ced-b35e-5243f88eefd6 req-7dccd582-e2dc-4b61-8506-2041a9d28f4a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.067316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e647bbfe-af42-43bc-8f9f-bd6074dbf8f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.847096 Jun 15 10:31:47.068078 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 27/66] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jun 15 10:31:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 10:31:47.073911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.074569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.082084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.082546 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.083447 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.084074 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.086524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-504ed660-a20d-4ced-b35e-5243f88eefd6 req-7dccd582-e2dc-4b61-8506-2041a9d28f4a service nova] Creating event network-changed:8d18190d-8f93-467b-a941-b38fe1222aae for instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f on hv-cinder-84349 Jun 15 10:31:47.087839 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-504ed660-a20d-4ced-b35e-5243f88eefd6 req-7dccd582-e2dc-4b61-8506-2041a9d28f4a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 10:31:47.091051 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.091711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.092910 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.093614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.110512 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.compute.rpcapi [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 10:31:47.112077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] Releasing lock "compute-rpcapi-router" {{(pid=118864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 10:31:47.164043 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a5141d85-319a-461f-bfa4-128bc9d7f36f None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141277 Jun 15 10:31:47.185641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 40/67] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:47.224399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b8d79b9a-6dd9-45e7-8b98-6ee770f943cf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.225399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b8d79b9a-6dd9-45e7-8b98-6ee770f943cf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.344413 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b8d79b9a-6dd9-45e7-8b98-6ee770f943cf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.354279 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b8d79b9a-6dd9-45e7-8b98-6ee770f943cf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.355814 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b8d79b9a-6dd9-45e7-8b98-6ee770f943cf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.357536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b8d79b9a-6dd9-45e7-8b98-6ee770f943cf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1282 microversion: 2.20 time: 0.164474 Jun 15 10:31:47.358320 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 41/68] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:47.373619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.374430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.381947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.395234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.396567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.397865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.434062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.444823 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-376dab68-e2b1-4a01-9ee3-7022b354e2ea tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.375554 Jun 15 10:31:47.445903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 28/69] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:47.473431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:47.474767 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:47.484265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.484942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.486773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:47.487429 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:47.569082 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.577664 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-29b1ef98-e1f3-4950-99c6-3f7d97952efc tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1244 microversion: 2.1 time: 0.109062 Jun 15 10:31:47.578532 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 29/70] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:47.679908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:47.689467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9d6c2f43-5a7c-4ca4-bc26-f3a09c485676 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.319368 Jun 15 10:31:47.690261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 42/71] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:47 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:48.375916 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.376636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.384455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.384939 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.385715 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.386171 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.450733 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.458890 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.460455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.460853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.461526 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.461628 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b130fc20-5aa0-4d05-ab08-cb26a2b6e80e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1286 microversion: 2.20 time: 0.089755 Jun 15 10:31:48.462309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 30/72] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:48.467824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.468264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.469017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.469443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.595695 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.596473 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.603427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.603930 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.604807 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.605226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.665610 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.673050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-eea748bc-2d5a-4b25-afc6-c06bd464ba87 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1244 microversion: 2.1 time: 0.081530 Jun 15 10:31:48.673614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 31/73] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:48.705424 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:48.705961 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:48.712064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.712514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.713269 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:48.713704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:48.847369 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:48.855819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4ac9a475-d2b5-488b-a708-933db4ce7a3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.154152 Jun 15 10:31:48.856475 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 32/74] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:49.113759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:49.125520 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f0e2ff9b-90ff-4a65-8f05-900dcaeeb9fc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.668400 Jun 15 10:31:49.126570 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 43/75] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:48 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:49.492516 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.494140 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.529020 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.531588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.536364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.539917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.687298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:49.690672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.691138 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:49.691472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.702176 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:49.704248 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:49.704405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.705438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.706761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1fa8a77c-977b-4c56-85c2-94d385ddd749 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1286 microversion: 2.20 time: 0.230960 Jun 15 10:31:49.708508 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.708972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.710629 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 33/76] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1286 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:49.823756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:49.834663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-900760ec-9d7f-4321-a21d-18a78b2c7258 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1244 microversion: 2.1 time: 0.148389 Jun 15 10:31:49.835930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 44/77] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1244 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:49.872553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:49.873162 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:49.884218 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.884669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:49.885442 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:49.885877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.142275 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:50.143351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:50.167596 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.168049 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.171710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.183712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.275159 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:50.290279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ec857851-fc0f-4db3-a905-2a07de8b6c90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.420967 Jun 15 10:31:50.294650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 34/78] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:49 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:50.585259 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:50.598391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-70e10f16-f9a0-46b2-a310-b65cb1d3c9bf tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.458078 Jun 15 10:31:50.600271 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 45/79] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:50 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:50.728968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:50.729659 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:50.761810 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.762483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.763318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.764256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.853587 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:50.854437 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:50.863457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.863913 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.865877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:50.866317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:50.889560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:50.905966 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:50.909125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:50.916287 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-942b07ab-0dbe-4131-8036-a0aec4cbb9f0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1334 microversion: 2.20 time: 0.193745 Jun 15 10:31:50.928011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 35/80] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:50 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1334 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:51.008634 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:51.023613 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6d8e6fc8-810a-4df9-9f16-493238ba1a5f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1292 microversion: 2.1 time: 0.175422 Jun 15 10:31:51.032527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 46/81] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:50 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:51.311232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:51.311962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:51.335154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.335783 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.336715 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.337618 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.766857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-59d9dab2-4e66-4263-969b-da34bd83a0f0 req-1caa1a4c-e813-4e2a-ac65-8e6a77879344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60658ba0-829b-4d71-9227-556791390b26", "name": "network-vif-plugged", "status": "completed", "tag": "fdbb94bf-b965-46d1-9c94-6a818e605361"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:51.781534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-59d9dab2-4e66-4263-969b-da34bd83a0f0 req-1caa1a4c-e813-4e2a-ac65-8e6a77879344 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.781996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-59d9dab2-4e66-4263-969b-da34bd83a0f0 req-1caa1a4c-e813-4e2a-ac65-8e6a77879344 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.822495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-59d9dab2-4e66-4263-969b-da34bd83a0f0 req-1caa1a4c-e813-4e2a-ac65-8e6a77879344 service nova] Creating event network-vif-plugged:fdbb94bf-b965-46d1-9c94-6a818e605361 for instance 60658ba0-829b-4d71-9227-556791390b26 on hv-cinder-84349 Jun 15 10:31:51.849142 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-59d9dab2-4e66-4263-969b-da34bd83a0f0 req-1caa1a4c-e813-4e2a-ac65-8e6a77879344 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378076 Jun 15 10:31:51.850044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 47/82] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:51.859646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:51.866243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:51.883039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.883605 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:51.884384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:51.884980 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.220049 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.228875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-51d692c9-6ed1-4617-b372-7732b278b008 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.375661 Jun 15 10:31:52.229441 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 48/83] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:51 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:52.253694 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:52.259508 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:52.278788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.279288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.280064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.280493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.387883 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.400632 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c8cd7005-0bbb-44f9-92c5-9240e4710c25 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 1.091327 Jun 15 10:31:52.401494 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 36/84] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:51 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:52.413099 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:52.416702 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:52.430793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.436819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.437903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:52.438341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:52.731182 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.742244 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.746896 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.748086 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9ba9fb6a-aa76-4660-94c9-bff59db290cd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1340 microversion: 2.20 time: 0.505801 Jun 15 10:31:52.752636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 49/85] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:52 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1340 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:52.769687 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:52.781132 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-81c8ad00-afd5-4e07-966e-378f04ca1895 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1298 microversion: 2.1 time: 0.377252 Jun 15 10:31:52.783709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 37/86] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:52 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1298 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:53.245515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.246294 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.258801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.260346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.261748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.262454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.418055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.418680 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.422735 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:53.436058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.436554 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.442378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.443029 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.646322 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:53.658575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c63246b8-b37e-43a4-8511-7a98ac4695fa tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.417586 Jun 15 10:31:53.660947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 50/87] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:53.770372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.771122 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.778823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.779592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.780616 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.781287 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.784822 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:53.795637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-97d35576-5b5a-49ab-8eb9-e5c784ff8240 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.381669 Jun 15 10:31:53.798590 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 38/88] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:53.803173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:53.803992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:53.819070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.819554 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:53.822105 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:53.825366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.204083 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:54.220377 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:54.222085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:54.223268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6b5311b8-2789-4d2e-ad74-eb4be21b0750 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.456941 Jun 15 10:31:54.245559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 51/89] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:31:54.457142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:54.471251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-88241506-6fe5-4fee-ab74-eb0c2032646f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.670366 Jun 15 10:31:54.485208 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 39/90] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:53 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:54.682440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:54.683349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:54.703939 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.704661 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.707722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.708391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.817074 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:54.819209 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:54.849234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.853321 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.855975 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:54.857146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:54.993568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:55.007206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b84f050d-e76a-455a-bb05-f8a064dd4767 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1315 microversion: 2.1 time: 0.334566 Jun 15 10:31:55.009162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 52/91] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:54 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:55.241931 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:55.242884 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:55.257837 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.258895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.263523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.264640 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.344062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:55.362926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6ac580f6-8f5a-4a08-b1fb-140d1a3f7ca4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.554710 Jun 15 10:31:55.364201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 40/92] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:54 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:55.490263 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:55.491710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:55.501187 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.504256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:55.507122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:55.508757 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.005033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.033015 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-dafb6c45-ae15-4664-baab-e2e7cce0823c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.546598 Jun 15 10:31:56.043849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 41/93] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:55 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:56.060528 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-656eee90-8e9a-47fd-8df9-bf9ac5ec2ddd req-153b7661-3e29-43df-93a2-9d6708d9c181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30aa81b-0ccd-437d-b0dc-401f2ba90533", "name": "network-vif-plugged", "status": "completed", "tag": "0e9fd3cd-585e-471d-9874-b29128afe6b7"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:56.079469 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-656eee90-8e9a-47fd-8df9-bf9ac5ec2ddd req-153b7661-3e29-43df-93a2-9d6708d9c181 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.080026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-656eee90-8e9a-47fd-8df9-bf9ac5ec2ddd req-153b7661-3e29-43df-93a2-9d6708d9c181 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.096952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-656eee90-8e9a-47fd-8df9-bf9ac5ec2ddd req-153b7661-3e29-43df-93a2-9d6708d9c181 service nova] Creating event network-vif-plugged:0e9fd3cd-585e-471d-9874-b29128afe6b7 for instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 on hv-cinder-84349 Jun 15 10:31:56.109165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-656eee90-8e9a-47fd-8df9-bf9ac5ec2ddd req-153b7661-3e29-43df-93a2-9d6708d9c181 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065287 Jun 15 10:31:56.110876 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 42/94] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:56.121060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-2d78463a-af62-4a02-8667-f268b883a050 req-fcb6f701-c684-46ef-a4ea-51b2c0b22274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:56.135231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-2d78463a-af62-4a02-8667-f268b883a050 req-fcb6f701-c684-46ef-a4ea-51b2c0b22274 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.136574 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-2d78463a-af62-4a02-8667-f268b883a050 req-fcb6f701-c684-46ef-a4ea-51b2c0b22274 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.156230 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-2d78463a-af62-4a02-8667-f268b883a050 req-fcb6f701-c684-46ef-a4ea-51b2c0b22274 service nova] Creating event network-changed:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:31:56.165126 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-2d78463a-af62-4a02-8667-f268b883a050 req-fcb6f701-c684-46ef-a4ea-51b2c0b22274 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052272 Jun 15 10:31:56.167177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 43/95] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:56.177423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:56.178764 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:56.188289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.200522 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.204859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.207787 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.208350 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.212113 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.215688 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.220121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f9103bbf-90c5-4d39-9adf-5becafa6eb7c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.982145 Jun 15 10:31:56.243287 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 53/96] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:55 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:56.384253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:56.386458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:56.399478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.400127 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.401232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.401872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.740493 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:56.770297 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2b1ac598-dbaa-4718-afe0-0af77b3ecf95 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1502 microversion: 2.1 time: 0.601725 Jun 15 10:31:56.770884 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 44/97] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:56 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1502 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:56.923584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-ffde8631-ccc5-494a-a5c4-d8617531000a req-6f1d4dee-1e74-461f-822d-56c33635b792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af6cc0a-d588-4a98-a82a-56d49cd2c55c", "tag": "093ff4e7-eb5f-4b43-9bc3-63863d7ab03e"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:56.934116 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-ffde8631-ccc5-494a-a5c4-d8617531000a req-6f1d4dee-1e74-461f-822d-56c33635b792 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:56.934801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-ffde8631-ccc5-494a-a5c4-d8617531000a req-6f1d4dee-1e74-461f-822d-56c33635b792 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:56.961888 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-ffde8631-ccc5-494a-a5c4-d8617531000a req-6f1d4dee-1e74-461f-822d-56c33635b792 service nova] Creating event network-changed:093ff4e7-eb5f-4b43-9bc3-63863d7ab03e for instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c on hv-cinder-84349 Jun 15 10:31:56.972669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-ffde8631-ccc5-494a-a5c4-d8617531000a req-6f1d4dee-1e74-461f-822d-56c33635b792 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198640 Jun 15 10:31:56.974105 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 45/98] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:57.047971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:57.049438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:57.055959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:57.056951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:57.078841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.080576 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.082958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.084705 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.109387 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=4 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:57.162776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:57.187866 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d094d182-dbb4-499f-b769-80d1088dd163 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.811420 Jun 15 10:31:57.196478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 54/99] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:56 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:57.249546 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:57.250676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:57.263819 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.264280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.265620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:57.277150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:57.360317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=9 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:57.478476 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:57.502010 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d4070c1b-0ce8-4a64-b7f2-bd519733079a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.444924 Jun 15 10:31:57.504518 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 46/100] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:57 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:57.519327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:57.533138 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:57.535467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:57.538789 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0ff9869e-3e4a-4cf9-b926-f137be07d046 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.293968 Jun 15 10:31:57.541104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 55/101] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:57 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:58.133543 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-d2be2853-1b0a-446c-8153-db6931cca191 req-19c83484-1c02-4475-a108-0b98e90e5565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe2cfb9-3db4-4587-b3d8-441ba2bf145f", "name": "network-vif-plugged", "status": "completed", "tag": "8d18190d-8f93-467b-a941-b38fe1222aae"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:58.157470 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-d2be2853-1b0a-446c-8153-db6931cca191 req-19c83484-1c02-4475-a108-0b98e90e5565 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.158561 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-d2be2853-1b0a-446c-8153-db6931cca191 req-19c83484-1c02-4475-a108-0b98e90e5565 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.174061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-d2be2853-1b0a-446c-8153-db6931cca191 req-19c83484-1c02-4475-a108-0b98e90e5565 service nova] Creating event network-vif-plugged:8d18190d-8f93-467b-a941-b38fe1222aae for instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f on hv-cinder-84349 Jun 15 10:31:58.178858 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-d2be2853-1b0a-446c-8153-db6931cca191 req-19c83484-1c02-4475-a108-0b98e90e5565 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049600 Jun 15 10:31:58.183889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 47/102] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:31:58.211888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:58.212634 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.221065 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.221868 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.222799 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.223371 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.418584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7635dec5-00ae-4303-bed3-cf88ff069a1e"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:31:58.420577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.421954 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:58.431143 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-38bcd0ba-f3af-445c-a980-5c215b1d8f5e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.223112 Jun 15 10:31:58.433723 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.434184 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.434958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.435425 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.442514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 56/103] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:58.520864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:58.522109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.533130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.536817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.540549 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.542610 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.861043 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:58.871968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d2947a29-ea05-4697-bb82-30a6cae73887 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.354962 Jun 15 10:31:58.882261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 57/104] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:31:58.890695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:58.892687 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:58.909168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.911020 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.916188 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:58.916848 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:58.957175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:31:59.233169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-32dbf040-cd39-448a-9956-87c8ace0e085 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "POST /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822052 Jun 15 10:31:59.234743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 48/105] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:31:58 2022] POST /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:31:59.252716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:59.264924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:59.268524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:59.269970 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1c5b9d69-5ad5-4ef2-bba9-154e5210ea25 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.386512 Jun 15 10:31:59.271081 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 58/106] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:31:58 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:31:59.449414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:59.450355 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:59.460155 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.461050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.462727 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.463270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.616767 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:31:59.626968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-fe72d235-1a69-4d72-b648-8e05815c8da6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.182779 Jun 15 10:31:59.627750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 49/107] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:59 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:31:59.893722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:31:59.895032 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:31:59.905444 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.906382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:31:59.907952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:31:59.909150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.070492 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.079959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6d963abe-e5fe-46ad-a740-7abed9edcebb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.193349 Jun 15 10:32:00.081010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 59/108] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:31:59 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:00.289690 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:00.290291 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:00.302548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.303003 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.304088 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.304267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.497924 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.507598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.509222 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.510350 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bb9f8266-1e3f-47d4-832d-d642125073d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.225120 Jun 15 10:32:00.519419 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 50/109] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:00 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:00.644722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:00.645539 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:00.652258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.652799 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.657526 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:00.658227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:00.810854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:00.819524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-84ce8cf9-8ac0-4460-b0c0-250c0a5277a9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.179153 Jun 15 10:32:00.819833 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 60/110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:00 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:01.098781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.099693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.106148 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.106594 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.107371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.107797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.282818 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:01.286605 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:01.291873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f979089b-9a60-43a5-b350-020ae38a5bac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.198465 Jun 15 10:32:01.292862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 51/111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:01.529082 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.529586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.535851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.536607 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.537384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.537811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.680418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:01.689517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:01.691193 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:01.692310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d22d107e-e7e2-4fe4-8027-34e45aff225a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.167657 Jun 15 10:32:01.692870 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 61/112] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:01.837213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:01.838079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:01.848040 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.848803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:01.849811 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:01.850482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.085191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.097112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ab12d706-d0f4-497c-bceb-6b7d8610711c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.263551 Jun 15 10:32:02.100809 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 52/113] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:01 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:02.313644 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:02.313644 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:02.319660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.320679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.321527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.321972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.479718 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.487798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-83fa8fbf-cf5e-4281-8128-3d382edb25d0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.182904 Jun 15 10:32:02.488967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 62/114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:02 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:02.709897 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:02.710498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:02.716542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.716993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.717770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:02.718184 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:02.860956 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.870315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.872020 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:02.873168 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3494fc4e-1be3-4b85-bb0d-7722ffb2b289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.167092 Jun 15 10:32:02.874064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 53/115] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:02 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:03.114666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.115523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.122847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.123395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.124166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.124602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.271803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:03.280677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1d94ba11-1025-42c6-9e38-8f02225e1638 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.169813 Jun 15 10:32:03.281278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 63/116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:03.505505 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.506117 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.512867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.513491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.514391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.514811 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.674973 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:03.683541 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6c6fb31d-86fb-4433-afe3-9041dc3bc49b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.182222 Jun 15 10:32:03.684697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 54/117] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:03.892520 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:03.893064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:03.899071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.899547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:03.900343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:03.900780 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.034329 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:04.042673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:04.044197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:04.045286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-79aeb04d-e4a7-4016-b3e8-8c728b9b7f5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.156751 Jun 15 10:32:04.045832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 64/118] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:03 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:04.298047 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:04.298658 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:04.305142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.305588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.306341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.306772 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.436452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:04.443880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7a6ea53c-d1ef-4f39-bc81-a6a22c63e04d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.149697 Jun 15 10:32:04.444440 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 55/119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:04 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:04.703614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:04.704616 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:04.712972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.713917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.714959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.715626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.719466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-a3e2dceb-0f87-4839-baa8-8286f42589c2 req-c4238f64-9233-413e-909f-d9bce79f8d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "name": "network-vif-plugged", "status": "completed", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:04.740927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-a3e2dceb-0f87-4839-baa8-8286f42589c2 req-c4238f64-9233-413e-909f-d9bce79f8d93 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:04.741367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-a3e2dceb-0f87-4839-baa8-8286f42589c2 req-c4238f64-9233-413e-909f-d9bce79f8d93 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:04.771133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-a3e2dceb-0f87-4839-baa8-8286f42589c2 req-c4238f64-9233-413e-909f-d9bce79f8d93 service nova] Creating event network-vif-plugged:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:32:04.780575 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-a3e2dceb-0f87-4839-baa8-8286f42589c2 req-c4238f64-9233-413e-909f-d9bce79f8d93 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074143 Jun 15 10:32:04.781387 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 56/120] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:04.873205 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:04.880635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2fa27638-41ce-495f-8e71-7dd6457b2ca7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.183244 Jun 15 10:32:04.881192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 65/121] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:04 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:05.064137 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:05.065107 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:05.071864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.072307 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.073065 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.073518 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.197161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:05.205095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:05.206592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:05.207710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7fb0b940-e330-49be-8c79-d942ec6701da tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.147901 Jun 15 10:32:05.208257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 57/122] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:05 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:05.461059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:05.461663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:05.467771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.468217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.468967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.469399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.594235 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:05.603427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-390e653a-2500-4f76-ac88-fee6026daa0a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.146275 Jun 15 10:32:05.603989 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 66/123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:05 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:05.897556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:05.898163 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:05.904679 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.905118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:05.905869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:05.906298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.076295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:06.108415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bf854e5f-5727-4763-a5bc-cb536ff0d5ab tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.214465 Jun 15 10:32:06.109011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 58/124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:05 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:06.225321 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:06.227010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:06.235412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.236162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.237159 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.237778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.620063 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:06.620759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:06.627533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.628200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.629198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:06.629525 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:06.632098 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:06.640301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:06.641800 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:06.642894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fe89ee19-7e5d-4104-8c7c-c4174d114b19 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.421450 Jun 15 10:32:06.643478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 67/125] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:06 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:06.763883 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:06.771685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-eef3c3d6-81ed-4328-9532-8f002fe74459 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.155506 Jun 15 10:32:06.781548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 59/126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:06 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:07.126056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.126758 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.134016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.134458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.135264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.135693 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.290425 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:07.302410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c14649c7-8947-47d9-b7e1-a42cc1eb45db tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.180525 Jun 15 10:32:07.303858 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 68/127] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:07.662654 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.664030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.684758 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.685210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.685992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.686415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.788857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:07.789827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:07.802850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.804010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.805518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:07.808274 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:07.877054 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:07.887764 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:07.889504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:07.890958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-80e73588-20e5-4489-ae92-66c5bd71aeb6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1407 microversion: 2.20 time: 0.233404 Jun 15 10:32:07.892000 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 60/128] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:07.993995 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:08.001459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3ef1237e-42ea-48a3-9284-aac1780a25ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.216691 Jun 15 10:32:08.002048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 69/129] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:07 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:08.320060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:08.320670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:08.326950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.327430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.328190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.328622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.460319 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:08.468817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ee283069-e649-4c62-a354-024ba9596f60 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.152561 Jun 15 10:32:08.478601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 61/130] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:08 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:08.908994 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:08.909602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:08.916484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.916929 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:08.917703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:08.918191 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.018969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.025931 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.033302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.033742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.034791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.035404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.087236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.096936 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.098948 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.100552 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cd137163-0e10-469b-8d14-d25c90e1a1f9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1600 microversion: 2.20 time: 0.195777 Jun 15 10:32:09.101282 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 70/131] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:32:08 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1600 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:32:09.118387 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.118868 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.125242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.125681 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.126463 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.126862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.186509 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.195587 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c4ea3ab3-49b8-4225-b2f3-d1b8d8c3ee34 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1322 microversion: 2.1 time: 0.179660 Jun 15 10:32:09.196341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 62/132] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:09.248273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6fe06d09-a2d0-479f-9c18-90313d7f3cda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133669 Jun 15 10:32:09.248870 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 71/133] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:32:09.485737 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:09.486750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:09.493775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.494509 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.495332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.495906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.640494 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:09.665611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-35e45d57-0e75-4adf-8203-c5024b69c282 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.183556 Jun 15 10:32:09.670962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 63/134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:09 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:09.923056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-d6fa7cba-e093-4b2a-802a-6f6d91b9065a req-5252174d-8c0c-42ca-a1eb-d431b4767e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af6cc0a-d588-4a98-a82a-56d49cd2c55c", "name": "network-vif-plugged", "status": "completed", "tag": "093ff4e7-eb5f-4b43-9bc3-63863d7ab03e"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:09.946246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-d6fa7cba-e093-4b2a-802a-6f6d91b9065a req-5252174d-8c0c-42ca-a1eb-d431b4767e8f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:09.946246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-d6fa7cba-e093-4b2a-802a-6f6d91b9065a req-5252174d-8c0c-42ca-a1eb-d431b4767e8f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:09.957292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-d6fa7cba-e093-4b2a-802a-6f6d91b9065a req-5252174d-8c0c-42ca-a1eb-d431b4767e8f service nova] Creating event network-vif-plugged:093ff4e7-eb5f-4b43-9bc3-63863d7ab03e for instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c on hv-cinder-84349 Jun 15 10:32:09.977226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-d6fa7cba-e093-4b2a-802a-6f6d91b9065a req-5252174d-8c0c-42ca-a1eb-d431b4767e8f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057614 Jun 15 10:32:09.977844 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 72/135] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:10.213402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.214024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.226257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.226827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.228004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.228621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.447890 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:10.455681 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d8e2b21f-ce59-4716-923b-43b3ac9cc3af tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1516 microversion: 2.1 time: 0.246826 Jun 15 10:32:10.456261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 64/136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:10.473461 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:10.474633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.482168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.482876 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.483699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.484138 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.509422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'flavor' on Instance uuid 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:32:10.639980 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a622a49e-6a5a-4b3d-9651-ede588daa8ea tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f/action" status: 200 len: 32 microversion: 2.1 time: 0.170588 Jun 15 10:32:10.643129 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 73/137] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:32:10 2022] POST /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 10:32:10.649794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.650487 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.658175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.658796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.659649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.660313 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.686671 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:10.687499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:10.694604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.695430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.696411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:10.697052 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:10.716985 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:10.897506 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:10.910661 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ab3c02da-a759-4ae0-87d1-0e8a506632bc tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.264852 Jun 15 10:32:10.921257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 65/138] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:10.949744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:10.959234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-70906ded-5bd3-424b-84fd-024159b2744f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.276727 Jun 15 10:32:10.969542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 74/139] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:10 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:11.026441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-f34a79ec-22ad-4742-92ea-02de87b80e44 req-5a593651-6717-461e-a481-bf0d3d232874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:11.041776 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-f34a79ec-22ad-4742-92ea-02de87b80e44 req-5a593651-6717-461e-a481-bf0d3d232874 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.042519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-f34a79ec-22ad-4742-92ea-02de87b80e44 req-5a593651-6717-461e-a481-bf0d3d232874 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.064394 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-f34a79ec-22ad-4742-92ea-02de87b80e44 req-5a593651-6717-461e-a481-bf0d3d232874 service nova] Creating event network-changed:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:32:11.072520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-f34a79ec-22ad-4742-92ea-02de87b80e44 req-5a593651-6717-461e-a481-bf0d3d232874 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050148 Jun 15 10:32:11.078537 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 66/140] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:11.928167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:11.928782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:11.937107 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.937756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.938957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.939597 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.977995 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:11.982166 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:11.993749 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.994422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:11.995520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:11.996469 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:12.262919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:12.273942 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-21d871ef-3967-47bc-ad72-9262bebb706a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.348987 Jun 15 10:32:12.274528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 75/141] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:11 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:12.289079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:12.301495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4845830e-e323-4089-99e2-d0b7f6f5a28d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.327728 Jun 15 10:32:12.313635 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 67/142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:11 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:13.292791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.293898 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.301911 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.302465 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.303393 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.303799 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.318749 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.319369 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.330995 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.331471 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.332233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.332662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.466856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:13.474867 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-37989775-9ad5-45ef-8d82-a49fd8db32e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.186774 Jun 15 10:32:13.475515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 76/143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:13.480190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.480968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.487424 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.488047 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.488797 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.489223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.514741 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:32:13.533522 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:13.541345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b6ae3b1f-1e15-4a57-9842-095aa1436c07 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.226109 Jun 15 10:32:13.551791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 68/144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:13.592648 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:13.612458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1cb0317d-137b-466f-b802-ad889f243846 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "DELETE /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 204 len: 0 microversion: 2.1 time: 0.134866 Jun 15 10:32:13.613405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 77/145] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:32:13 2022] DELETE /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:32:13.621170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:13.621660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:13.627799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.628425 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.629183 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:13.629762 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:13.783413 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:13.790321 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:13.793551 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-56c8756b-f71b-4a5c-a68b-3e0559f39c78 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.176064 Jun 15 10:32:13.803144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 69/146] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:13 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:14.494963 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.496197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.503907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.504941 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.506491 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.508165 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.562840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.564248 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.582302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.582859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.583768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.584203 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.694336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:14.702709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-366d6e2d-c980-428f-add5-f0a9b89565a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.213473 Jun 15 10:32:14.703407 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 78/147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:14.773851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:14.781868 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ebf1284b-2152-49d5-b48b-dcc4878a95de tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.227498 Jun 15 10:32:14.782884 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 70/148] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:14.812685 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:14.813404 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:14.819501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.820509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.821296 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:14.821732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:14.955514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:14.963579 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-51cd40f3-59e3-42c0-84ea-c6cc9b90df7f tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.156097 Jun 15 10:32:14.964136 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 79/149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:14 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:15.720636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.721252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.727869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.728327 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.729098 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.729534 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.798677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.799338 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.805965 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.806413 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.807218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.807658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.944601 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:15.952090 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-785d9052-2de1-4484-bc33-2b15919282ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.157217 Jun 15 10:32:15.952655 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 80/150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:15.963496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:15.971854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4ee1df34-e86c-4608-b89f-05e124b1d980 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.255114 Jun 15 10:32:15.972398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 71/151] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:15.980580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:15.981182 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:15.987591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.987967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:15.988845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:15.989199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.153190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:16.162108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9bc51b81-b93b-4120-9dc0-7c13ee89fa6b tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.185747 Jun 15 10:32:16.162674 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 81/152] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:15 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:16.969181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:16.969906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:16.976998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.977538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.978371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:16.978874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:16.989253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:16.990481 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:16.999864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.001501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.002959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.003650 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.178355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:17.190133 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5cfe43eb-d090-4386-9852-27a875780378 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.204757 Jun 15 10:32:17.190741 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 82/153] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:16 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:17.198845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:17.199582 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:17.207704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.208167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.209131 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:17.210178 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:17.323827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:17.339036 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bff2325b-286a-4d75-8cad-05a48e568902 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1366 microversion: 2.1 time: 0.373700 Jun 15 10:32:17.340089 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 72/154] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:16 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:17.389104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:17.398823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-90846c9d-2df4-48ac-829a-14435c8a2335 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.207073 Jun 15 10:32:17.399447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 83/155] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:17 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:18.208699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.209423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.217614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.222790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.222790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.222790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.353801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:18.356423 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.357038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.361514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-02fdd3d4-4191-4d8e-9fae-714acba11cd4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.157250 Jun 15 10:32:18.362163 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 73/156] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:18.363503 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.363926 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.364787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.365263 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.416004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.416777 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.422915 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.423408 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.424156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.424582 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.587443 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:18.595906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-71caf18d-881d-42a8-9092-e7af512d57dc tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.184329 Jun 15 10:32:18.596656 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 74/157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:18.626267 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:18.634553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ec7e7156-d67e-497e-b37b-34981d5e6e8a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1556 microversion: 2.1 time: 0.281585 Jun 15 10:32:18.636084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 84/158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1556 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:18.656062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:18.656738 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:18.664391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.664930 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.665880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:18.666399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:18.744885 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4747001d-9e5c-4212-bc8d-edcfbe143540 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092622 Jun 15 10:32:18.745567 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 75/159] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:32:18 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:19.378197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:19.378811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:19.385825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.386219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.386988 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.387551 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.524365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:19.531874 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4d9dcc93-8b0a-4045-b070-9376f9eab3c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.157681 Jun 15 10:32:19.532693 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 85/160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:19 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:19.613834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:19.614434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:19.621202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.621637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.622379 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.622805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.781009 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:19.790644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-078c1954-affe-45d2-ad5b-b894d4c6d1a6 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.181062 Jun 15 10:32:19.793181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 76/161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:19 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:19.916079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-a60f59e8-cf24-4fc4-adb3-0ac3d84fa5db req-f366c2cc-b544-45b0-a5ee-eedafc44ac21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af6cc0a-d588-4a98-a82a-56d49cd2c55c", "tag": "093ff4e7-eb5f-4b43-9bc3-63863d7ab03e"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:19.924332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-a60f59e8-cf24-4fc4-adb3-0ac3d84fa5db req-f366c2cc-b544-45b0-a5ee-eedafc44ac21 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:19.924846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-a60f59e8-cf24-4fc4-adb3-0ac3d84fa5db req-f366c2cc-b544-45b0-a5ee-eedafc44ac21 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:19.935905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-a60f59e8-cf24-4fc4-adb3-0ac3d84fa5db req-f366c2cc-b544-45b0-a5ee-eedafc44ac21 service nova] Creating event network-changed:093ff4e7-eb5f-4b43-9bc3-63863d7ab03e for instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c on hv-cinder-84349 Jun 15 10:32:19.941060 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-a60f59e8-cf24-4fc4-adb3-0ac3d84fa5db req-f366c2cc-b544-45b0-a5ee-eedafc44ac21 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029156 Jun 15 10:32:19.941563 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 86/162] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:20.550120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:20.550726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:20.557623 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.558070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.559147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.559865 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.695475 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:20.703324 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-520b2795-f37e-43d6-90bb-d5c54b77cea0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.157295 Jun 15 10:32:20.703993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 77/163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:20 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:20.809111 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:20.809839 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:20.816322 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.816831 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.817643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:20.818076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:20.956040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:20.964667 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d25b14d1-cabd-40d1-b3b8-78e74cd1901c tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.160346 Jun 15 10:32:20.965255 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 87/164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:20 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:21.720673 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:21.721252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:21.727672 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.728106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.728842 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.729266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.856377 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:21.864056 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-29e43203-05a4-4e7a-a52a-87bc2ff77ed8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.147299 Jun 15 10:32:21.864639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 78/165] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:21 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:21.981889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:21.983214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:21.990278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.990828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:21.992209 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:21.992872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.161464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:22.172650 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c056d3f9-8f38-4cc5-b36c-f088563092e1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1554 microversion: 2.1 time: 0.194883 Jun 15 10:32:22.173956 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 88/166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:21 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:22.646658 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-81712ba7-ebab-4f18-aaf9-1d2382eda447 req-fce0b143-43dc-4242-bdc5-b9f3b50ae2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60658ba0-829b-4d71-9227-556791390b26", "name": "network-vif-unplugged", "status": "completed", "tag": "fdbb94bf-b965-46d1-9c94-6a818e605361"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:22.656335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-81712ba7-ebab-4f18-aaf9-1d2382eda447 req-fce0b143-43dc-4242-bdc5-b9f3b50ae2f5 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.657901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-81712ba7-ebab-4f18-aaf9-1d2382eda447 req-fce0b143-43dc-4242-bdc5-b9f3b50ae2f5 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.673235 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-81712ba7-ebab-4f18-aaf9-1d2382eda447 req-fce0b143-43dc-4242-bdc5-b9f3b50ae2f5 service nova] Creating event network-vif-unplugged:fdbb94bf-b965-46d1-9c94-6a818e605361 for instance 60658ba0-829b-4d71-9227-556791390b26 on hv-cinder-84349 Jun 15 10:32:22.678697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-81712ba7-ebab-4f18-aaf9-1d2382eda447 req-fce0b143-43dc-4242-bdc5-b9f3b50ae2f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037280 Jun 15 10:32:22.680021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 79/167] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:22.881374 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:22.881772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:22.888654 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.889431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:22.890368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:22.890796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.006514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-9e27ca4a-4557-4840-af2a-68859b7c340b req-6f99b944-cff4-4c6b-a885-d541a309861f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60658ba0-829b-4d71-9227-556791390b26", "name": "network-vif-deleted", "tag": "fdbb94bf-b965-46d1-9c94-6a818e605361"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:23.019174 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-9e27ca4a-4557-4840-af2a-68859b7c340b req-6f99b944-cff4-4c6b-a885-d541a309861f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.020056 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-9e27ca4a-4557-4840-af2a-68859b7c340b req-6f99b944-cff4-4c6b-a885-d541a309861f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.034054 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-9e27ca4a-4557-4840-af2a-68859b7c340b req-6f99b944-cff4-4c6b-a885-d541a309861f service nova] Creating event network-vif-deleted:fdbb94bf-b965-46d1-9c94-6a818e605361 for instance 60658ba0-829b-4d71-9227-556791390b26 on hv-cinder-84349 Jun 15 10:32:23.041815 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-9e27ca4a-4557-4840-af2a-68859b7c340b req-6f99b944-cff4-4c6b-a885-d541a309861f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039950 Jun 15 10:32:23.042819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 80/168] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:23.152298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:23.159234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:23.163376 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8a453265-8d3a-4710-8f5c-61d7cdf00d4c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.285846 Jun 15 10:32:23.173911 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 89/169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:22 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:23.190295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:23.190981 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:23.197773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.198211 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.198967 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:23.199417 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:23.274574 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:23.283018 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bb5c87eb-c9f8-4ed8-a4a3-67c002d19ec3 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1346 microversion: 2.1 time: 0.096914 Jun 15 10:32:23.283602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 81/170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:23 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:24.181611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:24.182218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:24.189896 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.190338 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.191106 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.191533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.299674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:24.300444 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:24.303066 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=88 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:24.308785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.309295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.310039 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.310504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.329095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:24.337288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-79912c04-7494-4c2e-a6cf-0751047e5ca8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.160112 Jun 15 10:32:24.338045 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 90/171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:24 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:24.343896 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:24.344341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:24.344794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lazy-loading 'fault' on Instance uuid 60658ba0-829b-4d71-9227-556791390b26 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:32:24.388680 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:24.396516 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-75fa9f25-cd95-424d-92f9-bc0daf72755a tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1351 microversion: 2.1 time: 0.100762 Jun 15 10:32:24.397072 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 82/172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:24 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:25.353504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:25.354104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:25.360335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.360728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.361482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.361912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.414277 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:25.415608 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:25.422382 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.422848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.423617 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.424048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.455643 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:25.456091 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:25.456550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lazy-loading 'fault' on Instance uuid 60658ba0-829b-4d71-9227-556791390b26 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:32:25.491510 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:25.496642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:25.499892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3ff8727d-c834-4729-a60e-1fa15649921b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.150150 Jun 15 10:32:25.500469 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 91/173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:25 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:25.505441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ae3112d2-8ac6-4a92-a3e1-919f02492b23 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1351 microversion: 2.1 time: 0.095444 Jun 15 10:32:25.506001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 83/174] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:25 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:26.517243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:26.517757 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:26.521287 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:26.521892 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:26.524645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.525097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.525864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.526298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.528616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.529065 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.529813 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.530237 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.560652 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:26.561087 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:26.561522 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lazy-loading 'fault' on Instance uuid 60658ba0-829b-4d71-9227-556791390b26 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:32:26.602707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e2794bd474425d9d75f21c1929972b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5f1986694e8f9ee6f55ef3995621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:26.611572 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-61f14a88-24fc-4b21-867d-0ff4948a7296 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 200 len: 1351 microversion: 2.1 time: 0.093893 Jun 15 10:32:26.612146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 84/175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:26 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:26.653781 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:26.661495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d131b99a-f1ed-4a51-9a63-d2831d2d9d20 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.148287 Jun 15 10:32:26.662054 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 92/176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:26 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:27.632544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.632544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.636817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.637270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.638076 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.638512 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.652245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] HTTP exception thrown: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Request method failure captured: Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 HTTP/1.1 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbTyh8FnmHQRC4WRryFV1cBpbAy845eHeISVdC7TcAeyY2SNIKvzJOFXK4TCCJyBFqdv8jD9esc7uKwdcTC4S5muqnphy7Cn_MoSIEFB7HodZq3CVkPrnNG9qnZ-eigJuS3d93Pecl9ehngfkv208WsLp6fQzNXh5UBfXQUETxUU0T8 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:32:27.657552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 38e2794bd474425d9d75f21c1929972b Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.658987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '60658ba0-829b-4d71-9227-556791390b26'} Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:32:27.659827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.661149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.662361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Returning 404 to user: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:32:27.662361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7a471bd2-4b63-49be-bb16-39c9ab3816d1 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 404 len: 111 microversion: 2.1 time: 0.034287 Jun 15 10:32:27.662361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 85/177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:32:27.677383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.677993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.684723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.685180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.685941 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.686376 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.763134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:27.764177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:27.771318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.771976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.772940 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:27.773433 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:27.789649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] HTTP exception thrown: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Request method failure captured: Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26/os-volume_attachments HTTP/1.1 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbTyh8FnmHQRC4WRryFV1cBpbAy845eHeISVdC7TcAeyY2SNIKvzJOFXK4TCCJyBFqdv8jD9esc7uKwdcTC4S5muqnphy7Cn_MoSIEFB7HodZq3CVkPrnNG9qnZ-eigJuS3d93Pecl9ehngfkv208WsLp6fQzNXh5UBfXQUETxUU0T8 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:32:27.801070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 38e2794bd474425d9d75f21c1929972b Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.802548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'server_id': '60658ba0-829b-4d71-9227-556791390b26'} Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:32:27.803339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:27.805347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:27.807407 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Returning 404 to user: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:32:27.808603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-eed4886e-c434-43e2-80e8-46e633887559 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049421 Jun 15 10:32:27.809478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:32:27.828528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:27.836309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a310b36a-3760-40e6-a8e8-68f703972776 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.162667 Jun 15 10:32:27.836874 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 93/179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:27 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:28.854101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:28.854695 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:28.861290 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.861725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.862487 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:28.862914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:28.995299 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:29.002916 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a8802b61-7345-4bea-be07-62f5a02501d5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.153260 Jun 15 10:32:29.003501 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 87/180] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:28 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:30.020135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:30.020723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:30.026959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.027462 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.028215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:30.028647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:30.167812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:30.175907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e7e1a50e-f807-4ba1-a0eb-6924f4d7223d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.159521 Jun 15 10:32:30.176482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 94/181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:30 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:31.194423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:31.195123 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:31.202529 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.203026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.203813 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:31.204256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:31.222622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:31.331691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:31.339474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c55d0eeb-8548-40aa-8a01-018c5de14db4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.149366 Jun 15 10:32:31.340028 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 88/182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:31 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:32.360968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:32.362158 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:32.370219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.371030 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.372307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:32.372795 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:32.513430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:32.521448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1bae44ea-52bd-43d9-8cba-bfaa65610082 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.167784 Jun 15 10:32:32.522012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 95/183] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:32 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:33.538750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:33.539865 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:33.546356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.546799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.547585 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:33.548014 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:33.682412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:33.689831 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d2b49166-4ef0-4d66-b4b9-dc1cde7c6b7d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.155214 Jun 15 10:32:33.690406 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 89/184] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:33 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:34.706485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:34.707108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:34.713871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.714313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.715067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:34.715584 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:34.848781 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:34.856597 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aae05ef6-4e5f-415c-a12a-8b9ae7ddf804 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.154213 Jun 15 10:32:34.857156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 96/185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:34 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:35.293048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.293536 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.300057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.300497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.301251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.301680 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.314922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] HTTP exception thrown: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Request method failure captured: Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 HTTP/1.1 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbTyh8FnmHQRC4WRryFV1cBpbAy845eHeISVdC7TcAeyY2SNIKvzJOFXK4TCCJyBFqdv8jD9esc7uKwdcTC4S5muqnphy7Cn_MoSIEFB7HodZq3CVkPrnNG9qnZ-eigJuS3d93Pecl9ehngfkv208WsLp6fQzNXh5UBfXQUETxUU0T8 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:32:35.316453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 38e2794bd474425d9d75f21c1929972b Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.318026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '60658ba0-829b-4d71-9227-556791390b26'} Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:32:35.318774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.319952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.321699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Returning 404 to user: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:32:35.321699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0d58a359-4a65-4338-b248-b5c8c26b5755 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "DELETE /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 404 len: 111 microversion: 2.1 time: 0.028610 Jun 15 10:32:35.321699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 90/186] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:32:35 2022] DELETE /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:32:35.327455 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.328248 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] [instance: 60658ba0-829b-4d71-9227-556791390b26] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.335107 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.335567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.336310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.336779 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.351273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] HTTP exception thrown: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Request method failure captured: Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 HTTP/1.1 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbTyh8FnmHQRC4WRryFV1cBpbAy845eHeISVdC7TcAeyY2SNIKvzJOFXK4TCCJyBFqdv8jD9esc7uKwdcTC4S5muqnphy7Cn_MoSIEFB7HodZq3CVkPrnNG9qnZ-eigJuS3d93Pecl9ehngfkv208WsLp6fQzNXh5UBfXQUETxUU0T8 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:32:35.355747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b8df5f1986694e8f9ee6f55ef3995621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b8df5f1986694e8f9ee6f55ef3995621 Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1038611185 Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 38e2794bd474425d9d75f21c1929972b Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-DeleteServersTestJSON-1038611185-project Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.357284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '60658ba0-829b-4d71-9227-556791390b26'} Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:32:35.358236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. Jun 15 10:32:35.359712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:32:35.361014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] Returning 404 to user: Instance 60658ba0-829b-4d71-9227-556791390b26 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:32:35.361014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-87b18015-f546-4c28-acf2-3426bddf3db2 tempest-DeleteServersTestJSON-1038611185 tempest-DeleteServersTestJSON-1038611185-project] 10.222.0.49 "GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26" status: 404 len: 111 microversion: 2.1 time: 0.034139 Jun 15 10:32:35.361014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 97/187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:35 2022] GET /compute/v2.1/servers/60658ba0-829b-4d71-9227-556791390b26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:32:35.885330 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:35.886255 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:35.904052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.904714 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:35.906019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:35.906453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:36.165471 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:36.178734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c976d52e-024c-4de0-852d-3c39f3b8fe2f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.307254 Jun 15 10:32:36.178734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 91/188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:35 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:37.195558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:37.196714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:37.203752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.204218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.205127 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:37.205683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:37.367331 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:37.377291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-99d33cc8-2dbb-4ced-b343-63ce0ffa99b0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.185716 Jun 15 10:32:37.377969 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 98/189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:37 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:38.397520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:38.398119 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:38.405634 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.406262 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.407622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:38.408194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:38.589856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:38.610188 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a7724951-36aa-42ac-9182-388c8228322e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.216220 Jun 15 10:32:38.610975 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 92/190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:38 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:39.627957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:39.629084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:39.639646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.640341 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.641564 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:39.642204 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:39.879332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:39.890452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-86374ec9-910a-44aa-a785-402e594d2328 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.266235 Jun 15 10:32:39.891574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 99/191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:39 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:40.909992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:40.910621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:40.923639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.927651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:40.929187 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:40.929730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:41.233752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:41.244474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-298ed256-0f88-42b4-bb0b-8e8deef892fa tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.340894 Jun 15 10:32:41.245848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 93/192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:40 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:42.261518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:42.262127 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:42.269995 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.270749 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.271839 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:42.272660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:42.482984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:42.492399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e4528efb-00c2-487f-b118-5c6fa821f52e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.234735 Jun 15 10:32:42.493902 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 100/193] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:42 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:42.785783 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-314425cc-4f8b-496a-b86c-dbe4ea941f70 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: .version_select at 0x7feb408d5430>, body: {"keypair": {"name": "tempest-keypair-1041345859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGruaGp5pMaXA5mIR79y00ek+XvS7N/BEbtxNjqTLLJX9KV5wGGJt8eKlS6Zz/4U75QZr6LDiNG667gsxFLSy3z/msrvhRd24X11EE2kYmfDvNxHyHasT5C+Igvmr3++cQ=="}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:42.816213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-314425cc-4f8b-496a-b86c-dbe4ea941f70 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:32:42.820210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-314425cc-4f8b-496a-b86c-dbe4ea941f70 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for user 9ca22364db8147f2a14f3a0c77f545de and project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:32:42.860201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-314425cc-4f8b-496a-b86c-dbe4ea941f70 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.337481 Jun 15 10:32:42.860771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 94/194] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:32:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:43.511560 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:43.511943 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:43.518024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.518680 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.519684 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:43.520296 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:43.672422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:43.680220 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-270a8498-997f-4413-af6c-2f74c97b9d8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.174104 Jun 15 10:32:43.681350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 101/195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:43 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:44.259584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-364900353", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a0a2aca-16d7-464a-ac23-ad5ba1ba4be6"}], "security_groups": [{"name": "tempest-securitygroup--2009524725"}], "key_name": "tempest-keypair-1041345859", "user_data": "}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:44.378752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] validate_networks() for [('1a0a2aca-16d7-464a-ac23-ad5ba1ba4be6', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:32:44.703712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:44.704366 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:44.706499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:44.713196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.713649 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.714590 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.715208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.827553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:32:44.828451 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:32:44.829411 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:32:44.830036 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:32:44.830700 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:32:44.842378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.842986 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.843916 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:44.844448 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:44.865350 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:32:44.870657 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for user 9ca22364db8147f2a14f3a0c77f545de and project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:32:44.884453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:32:44.887287 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:32:44.944175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5d36a990-1734-4144-86c5-97f892116e04 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690009 Jun 15 10:32:44.947474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 95/196] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:32:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:32:44.956042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c27dc0ac-bdd0-4015-912c-938ff6082d73 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:44.956917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c27dc0ac-bdd0-4015-912c-938ff6082d73 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:45.022713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c27dc0ac-bdd0-4015-912c-938ff6082d73 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:45.031158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c27dc0ac-bdd0-4015-912c-938ff6082d73 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1237 microversion: 2.1 time: 0.078580 Jun 15 10:32:45.032504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 96/197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:44 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:45.122314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:45.131617 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f109e706-5977-4c25-aa0c-be1fa14de93a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.437605 Jun 15 10:32:45.132284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 102/198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:44 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:46.049089 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:46.049683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:46.056907 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.057345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.058112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.058537 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.124013 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:46.131583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6d29f87d-905b-4507-a21a-98b5749f0255 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1289 microversion: 2.1 time: 0.086170 Jun 15 10:32:46.132157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 97/199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:46 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:46.148758 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:46.150050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:46.156914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.157457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.158287 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:46.158791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:46.303017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:46.311144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b39aa33e-aff7-4a94-a8cf-b6cd145154ce tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.166091 Jun 15 10:32:46.312051 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 103/200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:46 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:47.148690 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:47.149876 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:47.156383 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.157079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.157836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.158267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.261007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:47.268811 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0fa8ed38-e495-4fca-b8a9-78bed674e0f0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1295 microversion: 2.1 time: 0.123927 Jun 15 10:32:47.269367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 98/201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:47 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:47.328411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:47.329032 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:47.335076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.335549 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.336365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:47.337297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:47.483893 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:47.491555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-030f1b41-f508-4056-a6d2-f6a65fd097ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.166952 Jun 15 10:32:47.492381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 104/202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:47 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:48.287560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:48.288771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:48.296332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.296780 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.308844 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.308844 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.509249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:48.511643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:48.523330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.523558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.524885 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:48.529162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:48.630645 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:48.641073 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e715a279-689d-48ea-b751-26d616860247 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.357118 Jun 15 10:32:48.641649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 99/203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:48 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:48.706614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:48.715232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0a58e54c-b48a-476b-8309-755309ce0978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.210304 Jun 15 10:32:48.716033 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 105/204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:48 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:49.078000 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-e30417ff-f176-4af2-866d-300ab0859d17 req-43cf0ef7-0764-4714-a40b-3ae8d0c921e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8e51d7-b834-4fe4-8cea-02ce37c5cce2", "tag": "a02e7f61-e16c-43e4-9c88-b76eccfa416c"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:49.087914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-e30417ff-f176-4af2-866d-300ab0859d17 req-43cf0ef7-0764-4714-a40b-3ae8d0c921e3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.088626 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-e30417ff-f176-4af2-866d-300ab0859d17 req-43cf0ef7-0764-4714-a40b-3ae8d0c921e3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.116285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-e30417ff-f176-4af2-866d-300ab0859d17 req-43cf0ef7-0764-4714-a40b-3ae8d0c921e3 service nova] Creating event network-changed:a02e7f61-e16c-43e4-9c88-b76eccfa416c for instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 on hv-cinder-84349 Jun 15 10:32:49.129586 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-e30417ff-f176-4af2-866d-300ab0859d17 req-43cf0ef7-0764-4714-a40b-3ae8d0c921e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054866 Jun 15 10:32:49.131877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 100/205] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:49.660877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:49.661506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:49.670338 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.670737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.671555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.671993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.738966 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:49.739821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:49.747822 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.748368 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.749441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:49.750255 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:49.895662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:49.921765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e61a3100-7c06-419d-9443-7e162af1fd4a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.256009 Jun 15 10:32:49.922452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 106/206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:49 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:49.951721 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:49.960371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e487cc04-4723-4247-bb04-827e9e96545c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.231685 Jun 15 10:32:49.961136 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 101/207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:49 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:50.940165 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:50.940784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:50.947538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.948245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.950085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.950827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.955400 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:50.978128 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:50.978736 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:50.988954 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.989396 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:50.990166 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:50.990597 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:51.199534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:51.210248 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dcdbc634-c9b7-43e2-ad59-50cce9ed739e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.276238 Jun 15 10:32:51.220860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 107/208] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:50 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:51.448548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:51.459566 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6f6947c8-ff81-4f48-9016-1df95fccc54b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.485640 Jun 15 10:32:51.460949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 102/209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:50 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:52.234268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:52.235177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:52.245174 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.245849 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.246817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.247457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.409330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:52.417332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-12c84211-9a32-466d-a9e1-06ae80880e91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.192824 Jun 15 10:32:52.420821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:52 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:52.478589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:52.479959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:52.490588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.492872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.493709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:52.495375 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:52.697170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:52.705537 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-83f39933-09ac-4e77-b0e7-e5ce6e204d16 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.231270 Jun 15 10:32:52.706192 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 103/211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:52 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:53.437447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:53.438176 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:53.451242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.451894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.452825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.453418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.613573 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:53.627350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-520255c0-7922-43a6-afef-abcb43fd6b2d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.197503 Jun 15 10:32:53.628572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 109/212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:53 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:53.722911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:53.724139 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:53.740341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.741061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.742096 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.742727 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.813489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-781d41c1-0ebb-4c54-8d48-0cc74d2d6635 req-99af1a43-8d1f-4bd9-acf9-9e1683da5780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8e51d7-b834-4fe4-8cea-02ce37c5cce2", "name": "network-vif-plugged", "status": "completed", "tag": "a02e7f61-e16c-43e4-9c88-b76eccfa416c"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:53.830489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-781d41c1-0ebb-4c54-8d48-0cc74d2d6635 req-99af1a43-8d1f-4bd9-acf9-9e1683da5780 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:53.831427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-781d41c1-0ebb-4c54-8d48-0cc74d2d6635 req-99af1a43-8d1f-4bd9-acf9-9e1683da5780 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:53.847022 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-781d41c1-0ebb-4c54-8d48-0cc74d2d6635 req-99af1a43-8d1f-4bd9-acf9-9e1683da5780 service nova] Creating event network-vif-plugged:a02e7f61-e16c-43e4-9c88-b76eccfa416c for instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 on hv-cinder-84349 Jun 15 10:32:53.854679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-781d41c1-0ebb-4c54-8d48-0cc74d2d6635 req-99af1a43-8d1f-4bd9-acf9-9e1683da5780 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044656 Jun 15 10:32:53.855848 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 110/213] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:32:53.912706 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:53.921126 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8a4cbf01-ea27-4058-a5ea-f02b2cd525dd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.202046 Jun 15 10:32:53.921704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 104/214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:53 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:54.646627 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:54.647744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:54.657761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.658220 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.659042 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.659518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.884657 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:54.892424 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-762af476-a5b4-40eb-9bb7-edf5757910c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.251527 Jun 15 10:32:54.893092 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 111/215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:54 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:54.938721 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:54.939641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:54.943964 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:54.945035 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:54.951114 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.952316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:54.953421 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:54.954064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.029396 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=12 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:55.115381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:55.123699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7772a104-fa19-4651-b439-4f93f0d70d4b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.189431 Jun 15 10:32:55.124254 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 105/216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:54 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:55.908993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:55.909628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:55.916395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.916905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:55.917647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:55.918286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.063791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:56.072159 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fa7d2340-a68f-4197-b83c-bd02210c4c81 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1363 microversion: 2.1 time: 0.167100 Jun 15 10:32:56.081956 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 112/217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:55 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:56.140887 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:56.141335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:56.149484 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.150428 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.151649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:56.152573 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:56.310922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:56.319167 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1b47a93a-a9a0-453b-ad74-c04311b27f14 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.182964 Jun 15 10:32:56.319736 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 106/218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:56 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:57.089661 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.090377 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.096984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.097671 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.098635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.098997 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.272916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:57.285177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cfcb1eea-2995-4285-b671-643a9de2c824 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1549 microversion: 2.1 time: 0.200338 Jun 15 10:32:57.285748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 113/219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:57.303399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.303958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.310190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.310641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.311437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.311876 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.337487 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:57.338392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:57.345759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.346551 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.347540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:57.347971 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:57.407878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9beec827-386a-4ffd-985a-1bb97a5adcbd tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108634 Jun 15 10:32:57.408806 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 107/220] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:57.561261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:57.569794 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-db3c0a3f-32bb-42ce-bbf5-a8f455d9286e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.236797 Jun 15 10:32:57.570454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 114/221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:57 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:32:58.590232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:58.591190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:58.598257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.598942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.600305 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.601038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.897099 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:32:58.907038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a82e0423-35b9-48f3-931e-0d23e2ffb4fe tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1522 microversion: 2.1 time: 0.322049 Jun 15 10:32:58.907778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 108/222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:58 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:32:58.926168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-6fc633c2-c568-453b-90a4-b75c37a5551a req-5de23af5-935f-4bcb-b9be-a86522afffbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8e51d7-b834-4fe4-8cea-02ce37c5cce2", "tag": "a02e7f61-e16c-43e4-9c88-b76eccfa416c"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:32:58.935311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-6fc633c2-c568-453b-90a4-b75c37a5551a req-5de23af5-935f-4bcb-b9be-a86522afffbd service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:58.935901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-6fc633c2-c568-453b-90a4-b75c37a5551a req-5de23af5-935f-4bcb-b9be-a86522afffbd service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:58.948887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-6fc633c2-c568-453b-90a4-b75c37a5551a req-5de23af5-935f-4bcb-b9be-a86522afffbd service nova] Creating event network-changed:a02e7f61-e16c-43e4-9c88-b76eccfa416c for instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 on hv-cinder-84349 Jun 15 10:32:58.954002 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-6fc633c2-c568-453b-90a4-b75c37a5551a req-5de23af5-935f-4bcb-b9be-a86522afffbd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034874 Jun 15 10:32:58.954640 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 115/223] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:32:59.925090 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:32:59.926120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:32:59.942822 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.946887 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.947837 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:32:59.948370 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:32:59.985750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:00.222448 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:00.233116 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-42b0f7c6-3158-410e-90e0-7614ec0456b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1502 microversion: 2.1 time: 0.312036 Jun 15 10:33:00.244555 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 109/224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:32:59 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:00.250197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:00.250899 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:00.258105 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.258862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.260071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:00.260591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:00.562272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:00.570317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-97f449ad-f566-4256-8bd1-5e312ebc8ff4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1517 microversion: 2.1 time: 0.324270 Jun 15 10:33:00.571666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 116/225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:00 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1517 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:02.021451 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:02.023106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:02.031962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.032656 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.033422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.033850 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.059141 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'flavor' on Instance uuid b30aa81b-0ccd-437d-b0dc-401f2ba90533 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:33:02.181630 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-124fc678-70e1-4018-a5f6-dd417e7d3394 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/action" status: 200 len: 32 microversion: 2.1 time: 0.164290 Jun 15 10:33:02.182716 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 110/226] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:33:02 2022] POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:33:02.192459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:02.193055 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:02.200138 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.200429 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.201194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:02.201791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:02.352399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:02.359901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c12c7f9b-0f57-43a5-bafd-c730ec8ebb73 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.171918 Jun 15 10:33:02.360464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 117/227] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:02 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:03.378251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:03.378942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:03.388414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.388855 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.389617 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:03.390045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:03.527914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:03.536561 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-53b38234-2bb2-4795-9c90-81f6ac943906 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.162981 Jun 15 10:33:03.537196 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 111/228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:03 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:04.553702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:04.554493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:04.561148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.561606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.562396 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:04.562818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:04.698791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:04.708163 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-27690e81-70de-439b-a263-9bf21b86ac10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.158263 Jun 15 10:33:04.708724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 118/229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:04 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:05.724987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:05.725583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:05.732381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.732831 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.733601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:05.734038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:05.862638 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:05.870639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a65dc485-b444-45b9-8316-9f1e5dfc6d10 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.149400 Jun 15 10:33:05.871226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 112/230] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:05 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:06.887798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:06.888401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:06.894372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.894814 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:06.895602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:06.896030 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:07.038021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:07.045448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-07e166bd-2e21-41e5-a227-84afdda4be2e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.161568 Jun 15 10:33:07.046000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 119/231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:06 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:08.061457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:08.061994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:08.068426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.068862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.069612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:08.070037 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:08.200171 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:08.207864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3379f983-e1b6-4331-8fa7-f1543fc9403a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.150167 Jun 15 10:33:08.208419 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 113/232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:08 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:09.225249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:09.225869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:09.232652 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.233109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.234063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.234498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.362089 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:09.369782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3c498e8c-123c-419a-bb95-b797ecac7d3a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.148580 Jun 15 10:33:09.370342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 120/233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:09 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:09.561249 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:09.561791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:09.568279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.568723 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.569479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:09.569911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:09.592699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3a96f5cc-68c8-411f-974a-e153b564666d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/ips" status: 200 len: 152 microversion: 2.20 time: 0.035362 Jun 15 10:33:09.593250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 114/234] 10.222.0.49 () {60 vars in 1288 bytes} [Wed Jun 15 10:33:09 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:33:10.386095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:10.386825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:10.393064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.393515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.394278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:10.394716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:10.526019 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:10.537282 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bf73cfde-3eb6-47cd-8f2d-c47a57b029e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.155552 Jun 15 10:33:10.537835 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 121/235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:10 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:11.553434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:11.554215 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:11.560868 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.561311 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.562088 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:11.562513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:11.692707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:11.700314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-dd9e08ac-dea6-40be-907d-9fb21d00172d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.150690 Jun 15 10:33:11.700865 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 115/236] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:11 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:12.718789 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:12.719274 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:12.725698 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.726900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.727880 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:12.728595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:12.865796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:12.873847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7d2aef77-4957-40d6-b77c-5d939eb88255 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.160561 Jun 15 10:33:12.874406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 122/237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:12 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:13.803914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:13.804612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:13.811159 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.811641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.812556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.812935 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.836771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lazy-loading 'flavor' on Instance uuid 16e37acd-69b1-4758-8ab5-07ec67e9ae2f {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:33:13.892257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:13.893610 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:13.903058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.903577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:13.904606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:13.905114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.045782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:14.058985 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4cc996b0-a59e-4e71-8d79-69ecdb24961b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.170873 Jun 15 10:33:14.070131 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 123/238] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:13 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:14.127219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8935e242-9755-4dad-853f-949b9709d02b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/action" status: 202 len: 0 microversion: 2.20 time: 0.327011 Jun 15 10:33:14.128212 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 116/239] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jun 15 10:33:13 2022] POST /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:33:14.137043 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:14.137645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:14.144379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.145765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.146529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:14.147034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:14.281972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:14.290121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:14.291844 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:14.293079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-47a74f9a-71ee-4e15-ac31-4eb0a3380aa9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.160684 Jun 15 10:33:14.293705 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 124/240] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:14 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:15.077814 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:15.079112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:15.101868 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.102318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.103121 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.103553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.254402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:15.262334 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cfbd876b-e80c-4430-a967-68b71bf1a861 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.189111 Jun 15 10:33:15.263006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 117/241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:15.311778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:15.312386 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:15.314418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=46 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:15.321217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.321672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.322449 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.322889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.327380 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:15.364199 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:15.365257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:15.374034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.374507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.375784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:15.376221 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:15.401079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-230a24b2-e1a0-4dc6-9be3-1b9a940d928e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/ips" status: 200 len: 149 microversion: 2.1 time: 0.040978 Jun 15 10:33:15.401654 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 118/242] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:15.540459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:15.551618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:15.553213 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:15.555452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-33a3563d-0a56-466b-99c3-98e95cdb231e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.247937 Jun 15 10:33:15.556832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 125/243] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:15 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:16.279440 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:16.280055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:16.287079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.287560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.288351 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.288784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.451020 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:16.459264 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d12662e1-f003-4766-9f95-509a741461f3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.183884 Jun 15 10:33:16.459825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 119/244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:16 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:16.573716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:16.574327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:16.580718 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.581173 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.581949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:16.582387 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:16.814574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:16.828365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:16.830499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:16.832110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-24a44de3-976a-4828-a5ba-31ba606c3426 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.262263 Jun 15 10:33:16.833130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 126/245] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:16 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:17.477058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:17.477670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:17.487702 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.488159 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.488940 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.489378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.721275 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:17.733912 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-79772f1f-dca6-476c-9dae-4fc54376f7ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.261150 Jun 15 10:33:17.748773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 120/246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:17 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:17.853166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:17.853772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:17.862285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.869914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:17.871339 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:17.871936 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.111713 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:18.120753 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:18.122540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:18.123891 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ac11ca0d-ee88-4e73-b8b1-b5c95c4c7c53 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.276688 Jun 15 10:33:18.135076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 127/247] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:17 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:18.752951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:18.753605 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:18.760882 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.761333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.762154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:18.762527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:18.919948 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:18.930506 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3b10be76-57b6-4af8-b8f0-dcfb4d24f784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.180614 Jun 15 10:33:18.931156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 121/248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:18 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:19.141795 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:19.142964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:19.149472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.150182 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.150961 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.151668 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.300901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:19.310473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:19.312273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:19.313742 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f66a99d0-1815-4efa-976b-6327e98ec6b6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.175893 Jun 15 10:33:19.314298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 128/249] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:19 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:19.949731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:19.950539 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:19.957494 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.957940 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:19.958713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:19.959333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.072079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1532ea84-3027-42af-bdc3-fddb5622124c"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:20.089015 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:20.103953 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.105409 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.106268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.106804 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.229984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:20.237544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:20.247284 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-66963667-34b3-48c0-a0d5-27915342bbe6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.301627 Jun 15 10:33:20.248497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 122/250] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:19 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:20.336598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:20.338636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:20.353248 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.354041 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.355075 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:20.355776 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:20.483218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ae442525-f68b-4965-94d1-cef9fa6fe111 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418291 Jun 15 10:33:20.484225 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 129/251] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:33:20 2022] POST /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:20.544997 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:20.563758 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:20.565253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:20.566414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cddc0270-3ee4-49e2-a965-9f5c806862db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.235146 Jun 15 10:33:20.566962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 123/252] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:20 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:21.266101 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:21.267273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:21.275199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.275864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.276973 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.277569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.531184 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:21.540219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3315a537-5ff8-4206-9677-f6bd1b9fdd8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.278418 Jun 15 10:33:21.541603 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 130/253] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:21 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:21.586827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:21.587578 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:21.594402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.595045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.595961 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:21.596501 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:21.790309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:21.799767 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:21.801386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:21.802972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7e73dc8e-408b-43d1-9e6a-0bbc985ed362 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.221290 Jun 15 10:33:21.803670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 124/254] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:21 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:22.557992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:22.558606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:22.566464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.567189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.568884 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.570372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.793440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:22.826881 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:22.828035 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:22.834260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-72ddcca9-1a63-4153-a13c-70351e32f049 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.270143 Jun 15 10:33:22.838189 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.838638 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.845951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:22.846567 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:22.848467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 131/255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:22 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:23.119194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:23.121754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:23.123326 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:23.124510 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-926429c4-a187-4866-aaf7-1040d1f8eb99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.304865 Jun 15 10:33:23.125699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 125/256] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:22 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:23.865888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:23.866613 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:23.875121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.875594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:23.876429 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:23.876882 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.145098 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:24.146216 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:24.158024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.158376 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:24.166780 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a780be33-1f65-4951-a626-fcfdcea8a7a8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.304994 Jun 15 10:33:24.167406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 132/257] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:23 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:24.167954 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.168792 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:24.169223 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:24.583871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:24.593699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:24.597596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:24.599195 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-73f7452c-567e-4258-a711-bc20da33d473 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.457873 Jun 15 10:33:24.599951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 126/258] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:24 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:33:25.186339 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:25.189019 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:25.197636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.200434 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.204408 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.205292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.547048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:25.573352 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0fdf607e-686c-44ea-b72e-a7ddd8a0c283 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.392869 Jun 15 10:33:25.582869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 133/259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:25 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:25.620740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:25.622033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:25.624902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=44 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:25.635336 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.638162 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.644630 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:25.645808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:25.862286 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:25.872178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:25.873980 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:25.875678 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c484dff5-7f81-4e20-9e9f-582dd1d988f3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.261187 Jun 15 10:33:25.886801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 127/260] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:25 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:26.591177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:26.591787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:26.598206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.598845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.599817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.600505 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.761027 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:26.769180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-116f0e91-70ea-4b34-95ef-7a2be578f74e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.182320 Jun 15 10:33:26.770089 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 134/261] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:26 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:26.893911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:26.895310 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:26.902859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.903733 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:26.904705 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:26.905335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.082520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:27.093445 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:27.095058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:27.096369 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-17ddf2a7-ac27-48fd-8e51-732947ffa015 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.206588 Jun 15 10:33:27.097479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 128/262] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:26 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:27.787510 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:27.802920 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:27.811820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.812278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:27.813044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:27.813647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.020517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:28.033591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1c778575-1c8a-4be6-877e-f3492a81555e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.249776 Jun 15 10:33:28.034533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 135/263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:27 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:28.114751 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:28.115575 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:28.135422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.137724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.139736 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:28.141094 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:28.340891 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:28.354774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:28.356353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:28.357561 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ef86dee2-4bd6-400a-99c8-14cb257c1205 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.247083 Jun 15 10:33:28.358317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 129/264] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:28 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:29.052902 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.054877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.065133 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.065897 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.066898 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.067628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.372146 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:29.376116 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.376803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.383449 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.383889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.385285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.385285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.396823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3aaf60f0-f6fa-4e3d-94dd-6961952d8b24 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1503 microversion: 2.1 time: 0.348213 Jun 15 10:33:29.397751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 136/265] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:29.418064 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7423739-e3de-4f9f-832e-264654154d21"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:29.420861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.429236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.430158 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.431199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.431989 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.487917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] HTTP exception thrown: Cannot 'attach_volume' instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 while it is in vm_state rescued Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Request method failure captured: Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/os-volume_attachments HTTP/1.1 Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 74 Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbT6et4JMqBoWsOdn2Ym9JMKVSX3J81aX_m3gE1UmgYyhNRP-vipwrlrG_5xzsjm6FRel99SIUiGZnTUzewNJHlDm402FnGOBUeoBhuZVaIDt1uXxqXOAD7Yw0JcF1RvoalDzw2pFiC_EMmXWvomPs0TfmHo1HwGmpJwGYPKBn_yQfg Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:33:29.490028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 6d152f74395c4b6cb889058f612d502f Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {"volumeAttachment": {"volumeId": "d7423739-e3de-4f9f-832e-264654154d21"}} Jun 15 10:33:29.492023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Cannot 'attach_volume' instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 while it is in vm_state rescued Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'server_id': 'b30aa81b-0ccd-437d-b0dc-401f2ba90533', 'body': {'volumeAttachment': {'volumeId': 'd7423739-e3de-4f9f-832e-264654154d21'}}} Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:33:29.492853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 while it is in vm_state rescued Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:33:29.495379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:33:29.501974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:33:29.501974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:33:29.501974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 while it is in vm_state rescued Jun 15 10:33:29.501974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:33:29.501974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Returning 409 to user: Cannot 'attach_volume' instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 while it is in vm_state rescued {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:33:29.501974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0a3312a0-222b-4af9-9188-f520b275dbb3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079498 Jun 15 10:33:29.508978 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 137/266] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:33:29 2022] POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/os-volume_attachments => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 15 10:33:29.517526 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:29.518090 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.532883 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.533336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.534277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.534720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.671660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ebc49505-faf0-4e97-904e-b7d217e42d62 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/action" status: 202 len: 0 microversion: 2.1 time: 0.157767 Jun 15 10:33:29.673029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 138/267] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:33:29 2022] POST /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:33:29.689270 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:29.691632 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:29.721484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.721977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:29.724582 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:29.726519 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:30.044822 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:30.067779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:30.069348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:30.070701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1f9655d5-c19e-4b50-bc72-de9e0759c911 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.698512 Jun 15 10:33:30.071450 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 130/268] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:30.106470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:30.110540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:30.123430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ce53e37d-0e31-41fd-9839-563118ccedae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1511 microversion: 2.1 time: 0.445991 Jun 15 10:33:30.133373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 139/269] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:29 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:31.088975 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:31.090353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:31.099238 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.099694 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.100520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.100957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.142908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:31.143683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:31.156887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.157843 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.159071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:31.159742 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:31.399211 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:31.403415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:31.411719 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ab7ec2c9-f765-49e8-8eb2-530acd39dbf8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1511 microversion: 2.1 time: 0.273408 Jun 15 10:33:31.414129 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 140/270] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:31 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:31.417240 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:31.418816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:31.420556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ecd62cec-1b01-458e-87c8-dc3a4decd4b5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.334866 Jun 15 10:33:31.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 131/271] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:31 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:33:31.591438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-981223f0-0885-4186-954c-dd5503234431 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: .version_select at 0x7feb4137bdc0>, body: {"keypair": {"name": "tempest-keypair-1229680394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNosNZcCHGZa9qNGzTIFDD1zBzJsJjHHeT2HHlkAeIusqKZwI3le23VpH8XmiIZy+KFjxLcJ8YJtBWsSZ4Yy7BIVO451IMQHZ810JjR5SKm8PH+eCvqomIGkbvKn3G4i+A=="}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:31.607234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-981223f0-0885-4186-954c-dd5503234431 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:33:31.613239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-981223f0-0885-4186-954c-dd5503234431 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:33:31.641720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-981223f0-0885-4186-954c-dd5503234431 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054703 Jun 15 10:33:31.644058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 141/272] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:33:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:32.433082 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:32.434288 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:32.443683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:32.444920 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:32.453087 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.454627 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.455065 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.455858 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.456285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.458099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.459039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:32.460223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:32.627959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:32.636706 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0fa98781-409b-4f2d-88ef-2104153bcf79 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1511 microversion: 2.1 time: 0.208644 Jun 15 10:33:32.644588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 132/273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:32 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:32.694158 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:32.707777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:32.709312 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:32.711395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d59e10e3-8be8-4925-9bda-77f33e9bcd69 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.272082 Jun 15 10:33:32.712012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 142/274] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:32 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:33.377472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1855005790", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56f473a9-939b-4bd2-a5d0-e5eaaaa25745"}], "security_groups": [{"name": "tempest-securitygroup--322659793"}], "key_name": "tempest-keypair-1229680394", "user_data": "}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:33.505837 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] validate_networks() for [('56f473a9-939b-4bd2-a5d0-e5eaaaa25745', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:33:33.663297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:33.663907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:33.672132 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.672908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.673923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.674576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.847500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:33.858757 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8d4822d1-abfe-40e2-addb-8af38e375004 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1511 microversion: 2.1 time: 0.199446 Jun 15 10:33:33.869817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 143/275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:33 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:33.875431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:33.876350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:33.883237 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.883870 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.884796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.885375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.977374 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:33:33.978161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:33:33.978783 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:33:33.979369 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:33:33.980012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:33:33.993927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.994624 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:33.995647 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:33.996294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.013668 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:33:34.021090 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:33:34.036496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:33:34.039666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:33:34.053264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:34.063560 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:34.065779 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:34.067288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-576689c2-c5bb-4644-a87a-dd5932a04e42 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.195897 Jun 15 10:33:34.068901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 144/276] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:33 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:34.108539 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a18a3661-2403-4fd2-b494-363c5c8a4855 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.735502 Jun 15 10:33:34.109795 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 133/277] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:33:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:33:34.124314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8b3746b8-c90b-4986-946f-a2027df2343b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:34.125529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8b3746b8-c90b-4986-946f-a2027df2343b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:34.198995 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8b3746b8-c90b-4986-946f-a2027df2343b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:34.206746 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8b3746b8-c90b-4986-946f-a2027df2343b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1242 microversion: 2.1 time: 0.090599 Jun 15 10:33:34.208327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 145/278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:34 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:34.879296 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:34.881962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:34.906298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.906758 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:34.907771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:34.908371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.093421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:35.094136 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:35.111175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.111655 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.112646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.114498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.133775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.143732 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bf33235e-dfe6-4e53-9793-889024de17e3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1517 microversion: 2.1 time: 0.269597 Jun 15 10:33:35.144947 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 134/279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:34 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:35.227788 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:35.228653 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:35.238535 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.244144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.245270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:35.245973 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:35.331538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.342053 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-249fe23f-0e3a-4b6e-a91b-49a75121f4c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1294 microversion: 2.1 time: 0.121811 Jun 15 10:33:35.342828 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 135/280] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:35 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:35.401801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.410786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.413206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:35.414714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ddedfdf4-88db-4ee2-8466-34da3cdaed3c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1745 microversion: 2.20 time: 0.325336 Jun 15 10:33:35.426032 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 146/281] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:35 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1745 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:33:36.359527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:36.360120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:36.367750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.369893 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.371220 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.372956 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.435134 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:36.435726 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:36.445949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.450124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.451110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:36.455688 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:36.507150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:36.518392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-83a2d067-cef7-4acf-b3e3-b8f46047e096 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1300 microversion: 2.1 time: 0.162619 Jun 15 10:33:36.519455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 136/282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:36 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:36.708233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d5a2fbdb-ce03-4022-af43-3233ee4d729c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'create', calling method: .version_select at 0x7feb3ac803a0>, body: {"keypair": {"name": "tempest-keypair-1661791585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUQQ4c+U9YABRNphaUBYkFo4YrOvK4s2R+rBDpRGn2ulPJVWJla63rTvO2pzukpsCmCVcrH0suhO/mWh0Becuuy/2KFyf2i+YGBFlW4e/nLeC5Ey/m/nz/WkbicNXIA0A=="}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:36.714917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:36.724864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:36.727252 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:36.729310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7ff80a8d-8123-40b2-b3d9-69d7df1712f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1745 microversion: 2.20 time: 0.297879 Jun 15 10:33:36.730027 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 147/283] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:36 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1745 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:33:36.735324 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-d5a2fbdb-ce03-4022-af43-3233ee4d729c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:33:36.747045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-d5a2fbdb-ce03-4022-af43-3233ee4d729c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for user 6d152f74395c4b6cb889058f612d502f and project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:33:36.795240 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d5a2fbdb-ce03-4022-af43-3233ee4d729c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091230 Jun 15 10:33:36.798488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 137/284] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:33:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:37.298055 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d35f9f68-3955-41a3-abb7-e627fa9dfa14 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Action: 'create', calling method: .version_select at 0x7feb3b6ff4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1992786128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPvHt2tpnF/NwL9SOLHm45SaFLagWyicJiZp4PeSBMotEbovQZMZKe4uZ+esZI1SAvEqm2XpK4ie/SjolK6/fffxLMTuPO9+gCM9ZGE+gfujbdTvWW/bPtJnTLGb6yUGQ=="}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:37.313260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-d35f9f68-3955-41a3-abb7-e627fa9dfa14 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Getting quotas for project 440f69d2725e435ab11b2fc658e1e745. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:33:37.317217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-d35f9f68-3955-41a3-abb7-e627fa9dfa14 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Getting quotas for user 572ac94e242f414aab152286fa356335 and project 440f69d2725e435ab11b2fc658e1e745. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:33:37.347636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d35f9f68-3955-41a3-abb7-e627fa9dfa14 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053482 Jun 15 10:33:37.348977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 148/285] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:33:37 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:37.489106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-233529557", "imageRef": "4b2ff818-b076-4c6f-8faa-9b83f820b3dc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1992786128", "networks": [{"uuid": "a4ae88dd-d7f0-4a0b-b40d-bef2dda0eeab"}]}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:37.537201 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:37.538918 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:37.546852 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.547492 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.548577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.549411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.560132 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] validate_networks() for [('a4ae88dd-d7f0-4a0b-b40d-bef2dda0eeab', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:33:37.721284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:37.732203 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-55a42d3d-6fc4-490a-92b3-b71b69f7bc0d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.199434 Jun 15 10:33:37.733480 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 149/286] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:37 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:37.750935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:37.751855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:37.758523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.759072 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.759932 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:37.760434 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:37.922289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:37.935174 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:37.936723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:37.937924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-460063bd-cd4e-4ced-880c-2712bc6398e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1745 microversion: 2.20 time: 0.190992 Jun 15 10:33:37.948784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 150/287] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:37 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:38.600492 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-94ba767f-f0f0-4ae5-998d-63dddfe468bb req-f78de129-d973-4f5e-be31-bce493d103b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e49255f-b081-437b-9505-114a5239096e", "tag": "48f9266a-92e9-4fe2-a1e4-0ad05a509b70"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:38.618395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-94ba767f-f0f0-4ae5-998d-63dddfe468bb req-f78de129-d973-4f5e-be31-bce493d103b9 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.619168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-94ba767f-f0f0-4ae5-998d-63dddfe468bb req-f78de129-d973-4f5e-be31-bce493d103b9 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.649567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-94ba767f-f0f0-4ae5-998d-63dddfe468bb req-f78de129-d973-4f5e-be31-bce493d103b9 service nova] Creating event network-changed:48f9266a-92e9-4fe2-a1e4-0ad05a509b70 for instance 6e49255f-b081-437b-9505-114a5239096e on hv-cinder-84349 Jun 15 10:33:38.656173 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-94ba767f-f0f0-4ae5-998d-63dddfe468bb req-f78de129-d973-4f5e-be31-bce493d103b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059889 Jun 15 10:33:38.657690 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 151/288] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:33:38.700297 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:33:38.700802 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:33:38.701385 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:33:38.701914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:33:38.702775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:33:38.730109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.736884 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.738484 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.739031 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.750231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:38.751175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:38.759454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.764270 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.765349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:38.765943 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:38.794952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Getting quotas for project 440f69d2725e435ab11b2fc658e1e745. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:33:38.804019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Getting quotas for user 572ac94e242f414aab152286fa356335 and project 440f69d2725e435ab11b2fc658e1e745. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:33:38.836693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:33:38.838816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4b2ff818-b076-4c6f-8faa-9b83f820b3dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:33:38.948657 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8de1a974-33a7-4be7-9955-fee1b02965fd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464784 Jun 15 10:33:38.954825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 138/289] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:33:38.985057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a8fd30ce-821e-447c-ac55-ba5c2175b8a6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:38.987535 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a8fd30ce-821e-447c-ac55-ba5c2175b8a6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:39.084992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.096285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5ea14ac4-f10b-4b08-86a9-3a4a848b978a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.350179 Jun 15 10:33:39.107834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 152/290] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:38 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:39.114905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:39.119181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:39.129687 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.130884 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.131902 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:39.132489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:39.322556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a8fd30ce-821e-447c-ac55-ba5c2175b8a6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.329906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a8fd30ce-821e-447c-ac55-ba5c2175b8a6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1258 microversion: 2.1 time: 0.373287 Jun 15 10:33:39.334058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 139/291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:38 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1258 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:39.374397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.397395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.399276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:39.400676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fc0a3bba-574d-4fa5-99f3-4ee086059921 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.291553 Jun 15 10:33:39.401453 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 153/292] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:39 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:40.050071 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1565748492", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5357f5ea-5034-4116-bf4e-1ab906c37c40"}], "security_groups": [{"name": "tempest-securitygroup--1278841023"}], "key_name": "tempest-keypair-1661791585", "user_data": "}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:40.095777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-164b2d5e-add1-4bfc-ab87-00403417aff2 req-e8d100a3-5538-441f-b27d-0073dde038b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "name": "network-vif-plugged", "status": "completed", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:40.122990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-164b2d5e-add1-4bfc-ab87-00403417aff2 req-e8d100a3-5538-441f-b27d-0073dde038b5 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.123467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-164b2d5e-add1-4bfc-ab87-00403417aff2 req-e8d100a3-5538-441f-b27d-0073dde038b5 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.146221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-164b2d5e-add1-4bfc-ab87-00403417aff2 req-e8d100a3-5538-441f-b27d-0073dde038b5 service nova] Creating event network-vif-plugged:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:33:40.153105 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-164b2d5e-add1-4bfc-ab87-00403417aff2 req-e8d100a3-5538-441f-b27d-0073dde038b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061712 Jun 15 10:33:40.154903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 154/293] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:40.161769 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.162821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.171791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.172456 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.173487 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.174109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.333404 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:40.341782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-415dac59-198a-4e26-85b5-2a30df0dd1bf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.184723 Jun 15 10:33:40.342708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 155/294] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:40.360196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.360897 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.369761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.369761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.369761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.370105 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.459162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:40.467345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-87f4702a-e720-40c4-8e7b-4c05f047496a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1310 microversion: 2.1 time: 0.111125 Jun 15 10:33:40.479039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 156/295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1310 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:40.484435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:40.485310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:40.496240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.496686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.497453 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:40.497907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:40.646967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:40.658000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:40.659694 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:40.660946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-07f548af-fca5-440e-be30-8dc8589b6bab tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.180909 Jun 15 10:33:40.661584 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 157/296] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:40 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:41.361203 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:41.362605 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:41.369536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.370014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.370780 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.373544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.534639 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.546609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-55f011d7-8a05-4b0e-a679-1b092b46e818 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.189380 Jun 15 10:33:41.547486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 158/297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:41 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:41.552495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:41.553823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:41.560392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.561109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.562365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.562952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.634709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.658544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ee3a4e08-273d-488b-b158-9520688d6779 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1310 microversion: 2.1 time: 0.109554 Jun 15 10:33:41.659154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 159/298] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:41 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:41.686827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:41.687556 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:41.695261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.695728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.696529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:41.696963 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:41.930285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.933536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:41.946209 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.948148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:41.949891 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e258a0d3-e564-434d-b965-200ee1998b26 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.267027 Jun 15 10:33:41.951619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 160/299] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:41 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:42.564321 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:42.565421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:42.574771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.575591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.576440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.576944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.795717 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:42.807585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bfe23824-1302-47fb-9597-6fa5320d7871 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.246949 Jun 15 10:33:42.808430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 161/300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:42 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:42.813959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:42.814890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:42.822787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.823288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:42.824071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:42.824511 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.092879 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:43.111498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-784b4d5d-7ac7-49d4-9290-12ac4a01e8d7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.301467 Jun 15 10:33:43.111988 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 162/301] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:42 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:43.117142 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:43.117749 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:43.138700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.139176 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.139959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.140397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.652108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:43.666028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:43.668181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:43.669614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a37b8fa0-d3d1-42e2-b220-ea51452aef4b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.556643 Jun 15 10:33:43.670351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 163/302] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:43 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:43.826066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:43.826922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:43.829227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:43.836046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.836764 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:43.837554 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:43.837992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.173830 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:44.185219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-55b05633-68ed-41d9-8597-b5ac315ce884 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.362371 Jun 15 10:33:44.197288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 164/303] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:43 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:44.208590 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.210675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.217437 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.218139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.219144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.219772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.513436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:44.523135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bdf899bc-1f63-4afa-8185-4201b92e417d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.324502 Jun 15 10:33:44.523990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 165/304] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:44 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:44.529172 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-0c5aae03-e51f-47a6-8491-abc1c74bf63c req-60c84a7e-bf97-43b9-a190-145e32206dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:44.541634 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-0c5aae03-e51f-47a6-8491-abc1c74bf63c req-60c84a7e-bf97-43b9-a190-145e32206dd7 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.542115 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-0c5aae03-e51f-47a6-8491-abc1c74bf63c req-60c84a7e-bf97-43b9-a190-145e32206dd7 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.582164 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-0c5aae03-e51f-47a6-8491-abc1c74bf63c req-60c84a7e-bf97-43b9-a190-145e32206dd7 service nova] Creating event network-changed:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:33:44.594645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-0c5aae03-e51f-47a6-8491-abc1c74bf63c req-60c84a7e-bf97-43b9-a190-145e32206dd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066585 Jun 15 10:33:44.595754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 166/305] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:44.690856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:44.692249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:44.703306 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.704053 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.705041 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:44.705680 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:44.915435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:44.924440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:44.925936 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:44.927118 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a6586f1d-9186-4377-be1c-f0c8c591c217 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.240791 Jun 15 10:33:44.927649 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 167/306] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:44 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:45.209177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:45.212906 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:45.223681 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.224392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.225383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.225981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.475925 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:45.487014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6dba4894-c688-43f2-a4d9-324498f849ff tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.288949 Jun 15 10:33:45.487659 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 168/307] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:45 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:45.540276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:45.541150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:45.548419 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.549148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.550386 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.550996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.751682 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:45.772631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8280cdee-4365-45bc-b61d-0823ce586bbb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.235393 Jun 15 10:33:45.779349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 169/308] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:45 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:45.947039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:45.948001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:45.961330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.963925 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:45.965945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:45.969143 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.171291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.183465 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.185932 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.187405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-04ce509f-192c-49de-8b8b-ef05dfa2be35 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.245767 Jun 15 10:33:46.199129 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 170/309] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:45 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:33:46.204338 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-858499a6-42b6-41c6-855a-d12b45a48881 req-7028a067-081d-4cc7-a16f-aa25506053cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49255f-b081-437b-9505-114a5239096e", "name": "network-vif-plugged", "status": "completed", "tag": "48f9266a-92e9-4fe2-a1e4-0ad05a509b70"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:46.212603 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-858499a6-42b6-41c6-855a-d12b45a48881 req-7028a067-081d-4cc7-a16f-aa25506053cf service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.213360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-858499a6-42b6-41c6-855a-d12b45a48881 req-7028a067-081d-4cc7-a16f-aa25506053cf service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.226607 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-858499a6-42b6-41c6-855a-d12b45a48881 req-7028a067-081d-4cc7-a16f-aa25506053cf service nova] Creating event network-vif-plugged:48f9266a-92e9-4fe2-a1e4-0ad05a509b70 for instance 6e49255f-b081-437b-9505-114a5239096e on hv-cinder-84349 Jun 15 10:33:46.231750 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-858499a6-42b6-41c6-855a-d12b45a48881 req-7028a067-081d-4cc7-a16f-aa25506053cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Jun 15 10:33:46.232981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 171/310] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:46.504580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:46.505851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:46.518922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.519841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.521485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.522700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.691398 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.700254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dbb068c5-6a9b-49d2-af4f-527dcd68381b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.199936 Jun 15 10:33:46.701014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 172/311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:46 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:46.795627 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:46.796244 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:46.806641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.807266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.808056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:46.808490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:46.944021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:46.952225 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dc7c543b-4800-410d-b892-f925ea99ebc0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.160518 Jun 15 10:33:46.961979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 173/312] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:46 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:47.206386 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.207077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.214327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.214861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.215728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.216243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.325922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=10 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:47.364527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:47.373277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:47.374770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:47.375993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4f07e52e-1ea2-44d9-8d55-0879acdfe1bc tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.173814 Jun 15 10:33:47.376547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 174/313] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:47.717772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.718712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.727900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.730037 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.730846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.731332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.905217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:47.917137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-63d5faa2-9757-4c00-8493-d274745b8abd tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1367 microversion: 2.1 time: 0.202759 Jun 15 10:33:47.918290 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 175/314] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:47.969948 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:47.970577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:47.977756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.978290 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:47.979274 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:47.979784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.136800 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:48.144993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-08213dbe-5a43-42c8-a16e-94bcb285ee16 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.179333 Jun 15 10:33:48.145725 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 176/315] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:47 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:48.395703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:48.397088 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:48.403903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.404347 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.405116 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.405797 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.566084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:48.580445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:48.581943 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:48.583284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7735907a-1da6-4856-8099-74747b3e028a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.191575 Jun 15 10:33:48.596547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 177/316] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:48 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:48.672540 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] validate_networks() for [('5357f5ea-5034-4116-bf4e-1ab906c37c40', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:33:48.758403 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=4 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:48.761088 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=82 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:48.935283 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:48.935895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:48.956405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.957137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:48.962005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:48.964047 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.150853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.153932 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:49.159527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:33:49.160004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:33:49.160675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:33:49.161127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:33:49.161689 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:33:49.166009 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-eaa7ed81-4df4-4293-a503-84c9219456e7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1558 microversion: 2.1 time: 0.235034 Jun 15 10:33:49.166811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 178/317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:48 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:49.171949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.172823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.179998 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.180802 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.182142 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.182871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.187866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.188827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.189618 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.190040 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.218141 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:33:49.223253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Getting quotas for user 6d152f74395c4b6cb889058f612d502f and project 993c57bae00b4a0db1d8de0f5017630a. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:33:49.237800 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:33:49.241116 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:33:49.327833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e4964be5-3b3d-43d5-a236-ea5cdf7cb165 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 9.284200 Jun 15 10:33:49.329017 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 140/318] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:33:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 9287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:33:49.340137 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.343345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.352193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.352828 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.353745 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.403020 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.414207 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-20714dce-76c5-4163-b37e-a5b4bd0c05db tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.245866 Jun 15 10:33:49.427279 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 179/319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:49.433551 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0d68ce94-3adf-405b-ac45-21e3ade89c6d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.434480 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0d68ce94-3adf-405b-ac45-21e3ade89c6d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.483041 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-89310c42-9df3-418a-8c3e-f0926d09a5e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150943 Jun 15 10:33:49.483723 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 141/320] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:49.508400 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0d68ce94-3adf-405b-ac45-21e3ade89c6d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.523981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0d68ce94-3adf-405b-ac45-21e3ade89c6d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1246 microversion: 2.1 time: 0.094541 Jun 15 10:33:49.527124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 180/321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:49.605981 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:49.606870 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:49.624173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.624752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.625700 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:49.626131 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:49.980110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.994640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.997558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:49.998869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4e1df03a-5dcb-4d8b-ab40-59724088660c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.399010 Jun 15 10:33:50.011609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 142/322] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:49 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:50.431232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:50.431836 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:50.439964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.440394 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.441319 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.441854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.543061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:50.543956 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:50.551050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.551918 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.553369 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.553977 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.597692 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:50.607262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5e0cd5cc-126d-4b2d-b140-9e92627f6018 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.179791 Jun 15 10:33:50.623637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 181/323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:50 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:50.738223 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:50.746267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-71463063-ac55-431d-b464-d67a067de75d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.207252 Jun 15 10:33:50.746851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 143/324] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:50 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:50.806977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-54e0831a-9ded-4a09-b611-ae3510321119 req-5febc9a0-a051-4910-833a-447eddee669f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e49255f-b081-437b-9505-114a5239096e", "tag": "48f9266a-92e9-4fe2-a1e4-0ad05a509b70"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:50.815324 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-54e0831a-9ded-4a09-b611-ae3510321119 req-5febc9a0-a051-4910-833a-447eddee669f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:50.815768 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-54e0831a-9ded-4a09-b611-ae3510321119 req-5febc9a0-a051-4910-833a-447eddee669f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:50.828440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-54e0831a-9ded-4a09-b611-ae3510321119 req-5febc9a0-a051-4910-833a-447eddee669f service nova] Creating event network-changed:48f9266a-92e9-4fe2-a1e4-0ad05a509b70 for instance 6e49255f-b081-437b-9505-114a5239096e on hv-cinder-84349 Jun 15 10:33:50.833478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-54e0831a-9ded-4a09-b611-ae3510321119 req-5febc9a0-a051-4910-833a-447eddee669f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031065 Jun 15 10:33:50.834284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 182/325] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:51.017288 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:51.018176 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:51.024169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.024616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.025378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.025812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.159827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.169045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.170667 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.172077 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9276d2b6-883e-49d1-90cc-d6ad8e3cdcb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.158672 Jun 15 10:33:51.173099 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 144/326] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:51 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:51.625253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:51.626046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:51.633865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.634320 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.635118 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.635540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.764899 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:51.765325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:51.779216 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.784884 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.785015 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:51.785410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:51.807499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.822108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3539edf0-e7d3-485e-8a37-3374084b01a7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.200989 Jun 15 10:33:51.822683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 183/327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:51 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:51.860419 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:51.868053 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-28cd3b6c-5e00-4fd7-8395-8140d8faa4ef tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.109080 Jun 15 10:33:51.868613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 145/328] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:51 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:52.194041 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.194653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.200766 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.201246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.202007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.202448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.348948 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.358401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.359929 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.361170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3754d7d7-e1a8-499c-9262-e26b6d971870 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.171623 Jun 15 10:33:52.361710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 184/329] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:52.839305 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.839874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.846161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.846598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.847371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.847796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.888194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:52.889048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:52.896001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.896602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.897418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:52.897927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:52.962351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.970738 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8d52968c-3ac2-4309-9585-f707137c0bdd tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.088302 Jun 15 10:33:52.971018 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 185/330] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:52.987414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:52.995879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e68a8f59-fa2d-461f-836d-57927f52adf7 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.160522 Jun 15 10:33:52.996662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 146/331] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:52 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:53.379141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:53.379750 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:53.385851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.386300 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.387056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.387517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.523368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:53.531665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:53.533167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:53.534320 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-38cc8fd9-9b9d-4514-8426-86df71437424 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.159146 Jun 15 10:33:53.534871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 186/332] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:53 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:53.988031 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:53.988616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:53.990914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:53.996127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.996569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:53.997321 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:53.997748 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.012828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.013959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.031032 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.031528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.032314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.032752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.076411 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.085176 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0547e1b3-8088-477b-8446-509fcc99e9be tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.100926 Jun 15 10:33:54.086207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 147/333] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:53 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:54.107670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-a1afbb05-fab3-46c5-8a21-2bc7f7b1f6a0 req-5eee53cd-fa37-41c3-94cd-bd41514d9d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "name": "network-vif-unplugged", "status": "completed", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:54.121008 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-a1afbb05-fab3-46c5-8a21-2bc7f7b1f6a0 req-5eee53cd-fa37-41c3-94cd-bd41514d9d57 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.121550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-a1afbb05-fab3-46c5-8a21-2bc7f7b1f6a0 req-5eee53cd-fa37-41c3-94cd-bd41514d9d57 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.135228 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-a1afbb05-fab3-46c5-8a21-2bc7f7b1f6a0 req-5eee53cd-fa37-41c3-94cd-bd41514d9d57 service nova] Creating event network-vif-unplugged:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:33:54.147450 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-a1afbb05-fab3-46c5-8a21-2bc7f7b1f6a0 req-5eee53cd-fa37-41c3-94cd-bd41514d9d57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059380 Jun 15 10:33:54.148165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 148/334] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:54.206308 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.217949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-164d8db4-f1f3-435d-ae31-7e7a934c8fcb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.208987 Jun 15 10:33:54.219128 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 187/335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:54.272048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.272521 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.278731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.279230 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.279974 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.280651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.303870 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d40b8aa1-6857-4bee-a36d-e3cc499e468e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/ips" status: 200 len: 146 microversion: 2.1 time: 0.036111 Jun 15 10:33:54.304685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 149/336] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:33:54.554688 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:54.555470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:54.562681 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.563361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.564408 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:54.565149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:54.707560 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.717166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.718718 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:54.719938 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ca655d88-8e45-4f1d-903c-bc268a6c3578 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.170729 Jun 15 10:33:54.731615 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 188/337] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:54 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:55.102545 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:55.103120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:55.109588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.110031 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.110786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.111860 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.175214 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:55.183642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a7d8d798-2425-4eb4-8d67-b07e535c5db9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.085582 Jun 15 10:33:55.184198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 150/338] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:55 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:55.234734 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:55.235530 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:55.242390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.242843 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.243728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.244188 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.385190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:55.392808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-05a70f11-f23a-4bc1-9f19-2b72fe5e1992 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.161853 Jun 15 10:33:55.393390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 189/339] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:55 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:55.753259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:55.753788 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:55.761110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.761898 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.762917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:55.763531 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:55.900300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:55.908505 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:55.909988 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:55.911154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2a6ffb5f-6cf4-4a49-9d47-1e234458065d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.161959 Jun 15 10:33:55.911732 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 151/340] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:55 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:56.200155 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:56.200760 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:56.206894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.207378 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.208216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.208689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.327007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:56.335842 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-12762600-714d-41b1-8e05-282f85e1c9de tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.139408 Jun 15 10:33:56.337278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 190/341] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:56 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:56.409906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:56.410512 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:56.465245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.467404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.469226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.470144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.638862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:56.647158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6c9e1e88-07f7-409f-a4ff-84910aeceb7f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.240438 Jun 15 10:33:56.647827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 152/342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:56 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:56.929502 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:56.930044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:56.936465 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.936906 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:56.937657 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:56.938085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.081666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.090310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.091846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.093024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-77fbdc9d-ad11-485a-8c85-a1c079848eda tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.167544 Jun 15 10:33:57.093574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 191/343] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:56 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:57.353074 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:57.353624 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:57.360303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.360738 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.361528 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.361959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.433788 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.442214 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f627ca30-a88f-4203-9f0d-fbf58d06404d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.093131 Jun 15 10:33:57.443961 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 153/344] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:57 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:33:57.541602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3a70491-e6fd-482c-a973-54355b72f08e"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:33:57.542731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:57.549379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.549820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.550600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.551028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.663742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:57.664328 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:57.670853 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.671358 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.672133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:57.672565 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:57.837853 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:57.847295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-18fece9f-f505-428e-a17e-0ad507783728 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.187044 Jun 15 10:33:57.848190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 154/345] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:57 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:58.110614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.111573 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.118346 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.118899 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.119741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.120176 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.260584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:58.268591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:58.270077 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:58.271277 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-fa838410-6730-4271-b774-d0b9d5dfb96b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.164580 Jun 15 10:33:58.271865 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 155/346] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:33:58.460029 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.460731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.466678 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.467139 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.467892 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.468317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.531741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:58.543666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2e51a110-1e86-4332-8ca1-8e12cf965594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.087237 Jun 15 10:33:58.544654 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 156/347] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:58.865154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:58.866496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:58.874106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.874810 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:58.875779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:58.876367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.205200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:59.232115 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.234405 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=24 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:59.241743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-dad5e578-4a73-4989-a299-074b1e1c2ca1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.381165 Jun 15 10:33:59.242320 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 157/348] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:58 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:33:59.289671 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:59.290267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:59.296415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.296790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.297532 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.297954 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.315775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:59.433497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.441498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.443008 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.444689 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7356fba4-b274-4ef7-9f0f-bab4aef72a6c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.158885 Jun 15 10:33:59.445242 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 158/349] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:33:59 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:33:59.513957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:59.561487 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:33:59.562094 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:33:59.569109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.569549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.570302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:33:59.570716 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:33:59.631897 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:33:59.641317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4f972594-c860-4151-a636-3223231c2c65 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.083662 Jun 15 10:33:59.652642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 159/350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:33:59 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:00.258536 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.259050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.265960 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.266389 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.267202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.267629 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.399902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.407591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9e6385c7-0e5b-4a13-a7e1-375c8129a20a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.153114 Jun 15 10:34:00.408152 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 160/351] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:00.463456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.464060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.470147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.470593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.471381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.471821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.597691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.606542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.608086 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.609234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ff73cddb-1006-4eb0-bab2-86d46ab0b464 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1740 microversion: 2.20 time: 0.150311 Jun 15 10:34:00.609883 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 161/352] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:00.659225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:00.659826 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:00.665751 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.666194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.666944 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:00.667471 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:00.730533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:00.737908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-97c5aa1e-dd2d-4c7f-991b-c6626bb4dfaf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1250 microversion: 2.1 time: 0.082498 Jun 15 10:34:00.738459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 162/353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:00 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:01.425127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:01.425770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:01.432545 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.432987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.433748 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.434175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.564262 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:01.572395 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f579a20d-a3eb-4b27-b267-abf233f7f84c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.151441 Jun 15 10:34:01.572957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 163/354] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:01 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:01.627033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:01.627689 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:01.634169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.634615 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.635417 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.635961 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.811004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:01.819822 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:01.821852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:01.822906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-26a8ddf0-2c10-41ea-be9b-aff8570477f8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1722 microversion: 2.20 time: 0.199564 Jun 15 10:34:01.834385 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 164/355] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:01 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:01.839398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:01.840181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:01.846854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.847240 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.848096 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:01.848537 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:01.942433 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:01.951723 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c8002f2c-0298-4215-8d72-d9445ada24a5 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1242 microversion: 2.1 time: 0.115938 Jun 15 10:34:01.952844 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 165/356] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:01 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:01.961464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e1e7e31e-40e8-4e81-939c-7cef83f77f38 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.423856 Jun 15 10:34:01.975325 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 192/357] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:33:57 2022] POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-volume_attachments => generated 194 bytes in 4439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:02.589361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:02.589962 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:02.596757 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.597196 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.597941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.598362 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.728003 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:02.735361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6e5adc25-3728-4266-adf7-0560d0b4dab1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.149862 Jun 15 10:34:02.735913 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 166/358] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:02 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:02.842212 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:02.842833 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:02.849673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.850117 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.850876 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.851340 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.974975 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:02.975884 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:02.986463 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.987386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:02.988656 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:02.989275 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.060982 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.070900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.072727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.074405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a07b9c4b-b9a4-4214-9eb7-d88de9895950 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1722 microversion: 2.20 time: 0.236300 Jun 15 10:34:03.075361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 193/359] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:02 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:03.112895 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.121987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5c578e44-2d72-4308-abc5-f75d26e0e9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1298 microversion: 2.1 time: 0.154991 Jun 15 10:34:03.123108 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 167/360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:02 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:03.752288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:03.752914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:03.760187 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.760565 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.761335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:03.761772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:03.897368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:03.905454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bb918330-ced9-4437-9f20-d894fb3ce5fb tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.156815 Jun 15 10:34:03.906114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 194/361] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:03 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:04.093674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.094335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.101455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.101901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.102669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.103123 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.140333 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.141213 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.148927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.149762 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.150845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.151336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.217145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:04.220110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:04.227220 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0cc36751-16a5-4df5-ace0-a56c93922044 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1304 microversion: 2.1 time: 0.091310 Jun 15 10:34:04.227775 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 195/362] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:04.238381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:04.246481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:04.248059 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:04.249239 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-34f840db-ac75-40df-84b1-aa809c9b4e66 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1722 microversion: 2.20 time: 0.159874 Jun 15 10:34:04.249788 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 168/363] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:04.922470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:04.923075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:04.930406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.930887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:04.931675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:04.932103 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.057006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.064497 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5234656e-d707-48a9-87f4-af56d97d6e6f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.146725 Jun 15 10:34:05.065050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 196/364] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:04 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:05.244697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:05.245331 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:05.251855 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.252298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.253055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.253600 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.266539 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:05.267081 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:05.273688 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.274135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.274901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:05.275374 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:05.314010 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.321941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-62c29217-67c1-4a1e-bb2b-1290e3f18700 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1304 microversion: 2.1 time: 0.081047 Jun 15 10:34:05.322501 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 169/365] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:05 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1304 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:05.403831 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.411917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.413715 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:05.414856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fad1760b-fc21-48ec-919f-cce63a26853f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1722 microversion: 2.20 time: 0.152315 Jun 15 10:34:05.415441 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 197/366] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:05 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:06.080810 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:06.081524 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.088110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.088626 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.089482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.089991 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.339115 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:06.339776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.339883 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:06.347573 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.348018 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.348794 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.349225 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.350609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bcd0065a-5580-442f-9810-3fd86e1452b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.273534 Jun 15 10:34:06.351325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 170/367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:06 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:06.433719 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:06.434479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.441293 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.441993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.442949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.444109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.490673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:06.500576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-15e996bb-d775-470d-812b-fd8a8fcb4b4a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.166606 Jun 15 10:34:06.501164 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 198/368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:06 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:06.658744 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:06.669408 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:06.670979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:06.672929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-07be5374-a626-4f60-b4d3-46295f621c1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1665 microversion: 2.20 time: 0.242985 Jun 15 10:34:06.674059 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 171/369] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:06 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1665 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:06.691758 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "817a98c3-e571-457a-81a5-22d74492c8c9"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:06.693529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:06.700586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.704786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:06.705874 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:06.706529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.026309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-36f70652-83d1-41d8-9af9-68e065c088db req-a6c13911-73f7-4d5a-82d1-2e1836de3750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dc2e258-7d46-483d-b6d9-8c11d75d9b09", "tag": "b55b6c61-87be-499d-9c71-6698d6514e2d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:07.039485 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-36f70652-83d1-41d8-9af9-68e065c088db req-a6c13911-73f7-4d5a-82d1-2e1836de3750 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.041786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-36f70652-83d1-41d8-9af9-68e065c088db req-a6c13911-73f7-4d5a-82d1-2e1836de3750 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.053695 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-36f70652-83d1-41d8-9af9-68e065c088db req-a6c13911-73f7-4d5a-82d1-2e1836de3750 service nova] Creating event network-changed:b55b6c61-87be-499d-9c71-6698d6514e2d for instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 on hv-cinder-84349 Jun 15 10:34:07.065745 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-36f70652-83d1-41d8-9af9-68e065c088db req-a6c13911-73f7-4d5a-82d1-2e1836de3750 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043408 Jun 15 10:34:07.066365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 172/370] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:07.112521 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-348eedf9-fa93-48ef-9dde-3fd847b88c65 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.424731 Jun 15 10:34:07.118537 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 199/371] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Jun 15 10:34:06 2022] POST /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments => generated 188 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:34:07.259053 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:07.260082 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:07.267136 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.267693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.268560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.269225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.373871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:07.375421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:07.392528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.393121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.394006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.394554 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.399129 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-22460f56-5af0-4d72-8dd7-af6988fd23d5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/action" status: 202 len: 0 microversion: 2.20 time: 0.145618 Jun 15 10:34:07.399740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 173/372] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jun 15 10:34:07 2022] POST /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:34:07.407766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:07.408368 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:07.415000 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.415475 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.416251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.417257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.645699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:07.654438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e1b7c741-34cd-466d-9c52-201a34668bb3 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.287175 Jun 15 10:34:07.664271 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 200/373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:07 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:07.669377 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:07.670085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:07.676529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.677262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.678153 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:07.678510 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:07.679295 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:07.682681 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:07.693718 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:07.696366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:07.698456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ace98d75-d150-4364-90bb-1f0713f2c047 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1751 microversion: 2.20 time: 0.294663 Jun 15 10:34:07.711457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 174/374] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:07 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1751 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:07.823483 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:07.832335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ab1f6da0-3cca-40bf-89f0-a960504eb916 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.166682 Jun 15 10:34:07.835533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 201/375] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:07 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:08.234612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-5ea853c5-8402-4757-895e-aa6ea67e795e req-00fdb5f7-cc42-4849-915b-a6a9caf33abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "name": "network-vif-plugged", "status": "completed", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:08.245984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-5ea853c5-8402-4757-895e-aa6ea67e795e req-00fdb5f7-cc42-4849-915b-a6a9caf33abc service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.246936 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-5ea853c5-8402-4757-895e-aa6ea67e795e req-00fdb5f7-cc42-4849-915b-a6a9caf33abc service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.260095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-5ea853c5-8402-4757-895e-aa6ea67e795e req-00fdb5f7-cc42-4849-915b-a6a9caf33abc service nova] Creating event network-vif-plugged:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:34:08.265795 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-5ea853c5-8402-4757-895e-aa6ea67e795e req-00fdb5f7-cc42-4849-915b-a6a9caf33abc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036923 Jun 15 10:34:08.266913 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 175/376] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:08.671266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:08.672024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:08.679784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.680231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.681030 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.681536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.719209 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:08.720052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:08.733797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.733797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.734549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.735109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.894404 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:08.906365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e647127d-d7ea-4ef7-b0af-75848beaf69d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.236937 Jun 15 10:34:08.918633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 202/377] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:08 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:08.925284 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:08.935744 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:08.937239 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:08.938584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7ff0ced4-5edb-4fd6-bf64-1635eac33321 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1751 microversion: 2.20 time: 0.224072 Jun 15 10:34:08.943689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:08.947189 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 176/378] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:08 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:08.947348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:08.960155 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.961097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:08.962261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:08.963021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.119848 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:09.127867 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-afc69a8e-7d36-43b0-a628-b76a1e80be71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.206948 Jun 15 10:34:09.128504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 203/379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:08 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:09.924009 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:09.924613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:09.931302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.931748 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.932501 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.932931 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.956750 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:09.957407 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:09.964845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.965286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:09.966039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:09.966467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.105479 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.122334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.123918 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.125588 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a7618cd0-5152-4eda-8fe0-fe6fe209aaa4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.172719 Jun 15 10:34:10.126825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 204/380] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:09 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:10.133453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.140924 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-adea7836-84c3-49f4-8f51-1dd4fa1b02b0 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1358 microversion: 2.1 time: 0.220699 Jun 15 10:34:10.141628 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 177/381] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:09 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:10.144810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:10.145420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:10.151500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.151955 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.152716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:10.153156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:10.291832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:10.299716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ed87fcd0-c7c6-48af-a894-e7de3492d083 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.158662 Jun 15 10:34:10.300285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 205/382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:10 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:11.144332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.144898 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.151481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.151926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.152923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.153354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.157600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.158240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.165171 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.165616 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.166370 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.166810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.285132 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.294084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.295066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.295600 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.296753 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-44eef5e3-0fc1-4724-a96a-970030f9c404 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.156400 Jun 15 10:34:11.297313 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 178/383] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:11.303524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9c23e698-3077-478e-8a7b-4d72473793aa tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1548 microversion: 2.1 time: 0.149970 Jun 15 10:34:11.304079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 206/384] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:11.315898 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.316535 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.319116 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.319747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.322705 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.323252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.324078 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.324613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.325776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.326227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.327021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.327485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.458625 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.459360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.467116 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-52659cd6-f2f8-4824-90ac-53596cff5d64 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1548 microversion: 2.1 time: 0.151483 Jun 15 10:34:11.480725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f399cb0e-45d1-4299-9b20-c242ba3b4fb8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.155508 Jun 15 10:34:11.481710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 207/385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:11.482069 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 179/386] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:11.486544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.490061 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.490823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Searching by: {'deleted': False, 'project_id': '440f69d2725e435ab11b2fc658e1e745'} {{(pid=118864) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 10:34:11.497484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.497922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.498704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.499159 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.595232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.multi_cell_list [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 10:34:11.699464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-42cb56d4-12e4-42c0-bd33-ed8997fe14da tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216213 Jun 15 10:34:11.700062 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 208/387] 10.222.0.49 () {58 vars in 1124 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:11.710799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:11.711752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:11.719723 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.720296 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.721064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:11.721495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:11.856530 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:11.864122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1163d901-db22-4956-b60a-ad6f776abdd1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1548 microversion: 2.1 time: 0.157625 Jun 15 10:34:11.864686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 180/388] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:11 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:12.315185 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:12.315832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:12.323242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.323694 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.324458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.324924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.339301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:12.459732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:12.467964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:12.469443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:12.470581 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2162ae49-7378-4a6a-8d64-54af6a664c3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.159404 Jun 15 10:34:12.471156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 209/389] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:12 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:12.484938 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:12.485543 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:12.492472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.492912 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.493666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:12.494095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:12.624385 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:12.633989 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ef864d6c-e809-4639-8bb6-474f36fd1e8a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.152702 Jun 15 10:34:12.634550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 181/390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:12 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:13.367823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "271c3174-ac6d-4b7f-baab-17d268dda02e"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:13.368941 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:13.375599 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.376047 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.376907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.377353 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.488438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:13.489037 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:13.496204 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.496644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.497402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.497830 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.842562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:13.851602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:13.853089 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:13.854227 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-301a4337-fbce-424d-a958-92154dfd3b30 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.369592 Jun 15 10:34:13.854770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 182/391] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:13 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:13.859050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:13.859677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:13.865372 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.865817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.866569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:13.867119 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:13.994778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:14.002376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-569b3b7a-dd78-4c1d-9cd4-c69bd1cf493d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.146623 Jun 15 10:34:14.003154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 183/392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:13 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:14.188697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-54af42aa-5d5b-4898-b66d-726f268aa235 req-27fc7075-a927-471e-97f0-40124f8babea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dc2e258-7d46-483d-b6d9-8c11d75d9b09", "name": "network-vif-plugged", "status": "completed", "tag": "b55b6c61-87be-499d-9c71-6698d6514e2d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:14.198388 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-54af42aa-5d5b-4898-b66d-726f268aa235 req-27fc7075-a927-471e-97f0-40124f8babea service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.198947 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-54af42aa-5d5b-4898-b66d-726f268aa235 req-27fc7075-a927-471e-97f0-40124f8babea service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.213278 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-54af42aa-5d5b-4898-b66d-726f268aa235 req-27fc7075-a927-471e-97f0-40124f8babea service nova] Creating event network-vif-plugged:b55b6c61-87be-499d-9c71-6698d6514e2d for instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 on hv-cinder-84349 Jun 15 10:34:14.218247 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-54af42aa-5d5b-4898-b66d-726f268aa235 req-27fc7075-a927-471e-97f0-40124f8babea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033976 Jun 15 10:34:14.218899 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 184/393] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:34:14.872929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:14.873660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:14.880044 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.881066 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:14.881826 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:14.882257 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.016857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:15.025127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:15.026608 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:15.027775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b47f34cd-fcac-45e3-9c6e-c262159c785f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.159490 Jun 15 10:34:15.028327 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 185/394] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:14 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:15.032872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:15.033468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:15.040069 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.040533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.041283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:15.041711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:15.171992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:15.180312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3671cd52-1d98-4d3c-b272-83f936fe4a2b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.150976 Jun 15 10:34:15.180872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 186/395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:15 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:16.047146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:16.047774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:16.054677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.055138 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.055891 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.056322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.184442 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:16.195864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:16.197409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:16.199398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f60a6b83-66e3-4a8f-8a5e-d83400d66c46 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.156039 Jun 15 10:34:16.200324 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 187/396] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:16 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:16.208614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:16.209253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:16.218590 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.219120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.220252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:16.220794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:16.381840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:16.394212 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1a6392e3-435c-4708-a111-07ab9cc59699 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.192783 Jun 15 10:34:16.394781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 188/397] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:16 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:16.924192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cc334e79-cc5d-44db-8944-be19e41f4e5f tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.560669 Jun 15 10:34:16.924788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 210/398] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:34:13 2022] POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments => generated 194 bytes in 3562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:17.217899 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:17.218469 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:17.226766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.227245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.228122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.228452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.393213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:17.402329 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:17.403872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:17.405313 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-077125d7-891e-4641-8efe-94b206723b1a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.191203 Jun 15 10:34:17.405869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 189/399] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:17 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:17.412761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:17.413443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:17.415425 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=96 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:17.421005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.421448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.422208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.422637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:17.558737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:17.566265 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0ae650fa-5adc-4db7-80a3-cd236618454d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.158192 Jun 15 10:34:17.566837 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 211/400] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:17 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:17.990744 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ec3cac19-c79a-4bc0-8225-dd619707660d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:17.996854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ec3cac19-c79a-4bc0-8225-dd619707660d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:17.997295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ec3cac19-c79a-4bc0-8225-dd619707660d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.057656 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ec3cac19-c79a-4bc0-8225-dd619707660d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Going to try to stop instance {{(pid=118865) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 10:34:18.099230 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ec3cac19-c79a-4bc0-8225-dd619707660d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action" status: 202 len: 0 microversion: 2.1 time: 0.112141 Jun 15 10:34:18.099830 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 190/401] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:34:17 2022] POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:34:18.107820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:18.108426 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:18.114921 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.115408 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.116214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.116650 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.246072 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:18.254020 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-886256e3-a5c2-4141-876b-a8293b7e2018 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.150019 Jun 15 10:34:18.254564 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 212/402] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:18 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:18.424207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:18.424894 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:18.431671 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.432114 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.432867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.433298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.571319 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:18.583334 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:18.584474 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:18.585216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:18.590390 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:18.592512 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.596488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:18.596488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4826f45a-90e0-4436-90e8-442bd173c52e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1753 microversion: 2.20 time: 0.174546 Jun 15 10:34:18.596488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 191/403] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:18 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:18.598257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.599134 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:18.599751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:18.932996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:18.940736 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-668a5bae-64cf-4d2a-bcd9-4289e2476a1b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1372 microversion: 2.1 time: 0.361177 Jun 15 10:34:18.941301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 213/404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:18 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1372 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:19.273614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:19.274218 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:19.281221 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.281670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.282560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.283189 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.445277 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:19.453976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-93e72151-7a59-4f16-b7cb-de08dcfcac11 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.186586 Jun 15 10:34:19.454561 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 192/405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:19 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:19.613277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:19.613827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:19.619834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.620316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.621027 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.621454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.751802 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:19.760341 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:19.761825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:19.762961 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-199c1094-8660-4c9f-9521-1d7345971601 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.153909 Jun 15 10:34:19.763542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 214/406] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:19 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:19.957718 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:19.958315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:19.964989 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.965507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:19.966226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:19.966650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.139707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:20.149265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8ebde467-a9da-4d3b-aeb8-2e7d9e1c7594 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1566 microversion: 2.1 time: 0.195399 Jun 15 10:34:20.150101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 193/407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:19 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:20.167306 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:20.167808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:20.174021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.174474 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.175413 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.175854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.252570 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0baf2852-1060-40b3-ab6d-a47e6281855e tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089802 Jun 15 10:34:20.253168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 215/408] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:34:20 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:34:20.473998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:20.474729 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:20.481300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.481750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.482521 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.483078 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.757141 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:20.779411 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-50732a1d-df91-47d1-b87b-ac0c99936603 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.310282 Jun 15 10:34:20.780771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 194/409] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:20 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:20.789164 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:20.790343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:20.800384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.800827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:20.801593 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:20.802205 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.010922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:21.023717 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:21.025412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:21.026707 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-803ea210-218f-4d59-be4c-3b98e75a40e4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.248938 Jun 15 10:34:21.027703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 216/410] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:20 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:21.285231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-7b69fa6a-7818-4d58-b533-b82575ccfe6e req-97472570-b8f8-41d8-89c4-2b3fae69e28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dc2e258-7d46-483d-b6d9-8c11d75d9b09", "tag": "b55b6c61-87be-499d-9c71-6698d6514e2d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:21.296018 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-7b69fa6a-7818-4d58-b533-b82575ccfe6e req-97472570-b8f8-41d8-89c4-2b3fae69e28b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.296776 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-7b69fa6a-7818-4d58-b533-b82575ccfe6e req-97472570-b8f8-41d8-89c4-2b3fae69e28b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.310863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-7b69fa6a-7818-4d58-b533-b82575ccfe6e req-97472570-b8f8-41d8-89c4-2b3fae69e28b service nova] Creating event network-changed:b55b6c61-87be-499d-9c71-6698d6514e2d for instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 on hv-cinder-84349 Jun 15 10:34:21.317065 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-7b69fa6a-7818-4d58-b533-b82575ccfe6e req-97472570-b8f8-41d8-89c4-2b3fae69e28b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036370 Jun 15 10:34:21.318567 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 195/411] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:21.799506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:21.800688 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:21.811448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:21.813848 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.814456 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:21.815595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:21.816217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.028826 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:22.037706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-82bc3b33-0fa7-4b6f-8f38-9c05673d08ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.244297 Jun 15 10:34:22.047912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 217/412] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:21 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:22.055142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:22.055838 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:22.061300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:22.063410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.063866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.064838 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:22.065426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:22.214048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:22.223647 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:22.225464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:22.226648 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-21b58814-88f8-4fdd-a8ea-5e542484e2dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.177708 Jun 15 10:34:22.227218 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 196/413] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:22 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:23.057138 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:23.057702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:23.064714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.065157 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.066005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.066435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.207965 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:23.216501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a907369b-0343-4703-8f04-472608d5e465 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.163378 Jun 15 10:34:23.217192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 218/414] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:23 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:23.245717 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:23.246378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:23.253266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.253715 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.254491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:23.254945 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:23.398610 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:23.409353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:23.410950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:23.412260 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4a224c3d-7f12-4c8a-abb0-945432c0f994 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.171137 Jun 15 10:34:23.412805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 197/415] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:23 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:24.233963 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:24.234553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:24.241066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.241514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.242272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.242706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.382314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:24.393097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c3a87a81-f8db-4850-bcbe-bec0c56f917a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.162942 Jun 15 10:34:24.402802 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 219/416] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:24 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:24.431483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:24.432112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:24.438785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.439267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.440029 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:24.440461 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:24.583468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:24.591979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:24.593496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:24.594661 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-10e68a9b-9b16-44ca-98eb-ed38fb2c0e1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.167626 Jun 15 10:34:24.595224 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 198/417] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:24 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:25.409960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:25.410548 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:25.417583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.418226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.419039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.419518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.571838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:25.579998 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-34530784-db49-44f7-90da-931cfeb53efa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.173818 Jun 15 10:34:25.580861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 220/418] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:25 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:25.614124 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:25.614721 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:25.620812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.621250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.622000 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:25.622426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:25.755622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:25.764568 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:25.766056 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:25.767225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-751f37c2-b9d5-4bd7-aec3-ccbe193b5dd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.157523 Jun 15 10:34:25.767782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 199/419] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:25 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:26.598110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:26.598700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:26.605961 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.606410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.607286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.607829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.759955 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:26.768074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-da286c0c-1a60-4a7a-80e1-df1c22077f1b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.173880 Jun 15 10:34:26.768633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 221/420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:26 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:26.786172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:26.786782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:26.793918 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.794361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.795150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:26.795759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:26.933215 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:26.943401 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:26.944982 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:26.946263 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-03057b5b-ac72-4440-8d9e-3130e797ddf3 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.164483 Jun 15 10:34:26.946866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 200/421] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:26 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:27.784947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:27.785564 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:27.793905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.794343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.795137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.795842 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.950049 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:27.964985 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:27.965636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:27.969547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-413c2e9a-2fa3-4534-a325-7f8c1f5fe371 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.188346 Jun 15 10:34:27.970130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 222/422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:27 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:27.972370 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.972861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:27.973808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:27.974309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.107769 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:28.116740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:28.118367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:28.119663 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8e0655f9-10e6-488a-83b2-2078cc613b97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.158977 Jun 15 10:34:28.120423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 201/423] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:27 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:28.987628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:28.988362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:28.995719 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.996175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:28.997091 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:28.997694 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.138205 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:29.139165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:29.144998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.145786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.146793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:29.147619 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:29.155297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:29.163756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-58fa58b2-dce3-40b8-8d55-24aeb48f25ec tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.180371 Jun 15 10:34:29.165542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 223/424] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:28 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:29.300073 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:29.309027 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:29.310697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:29.311974 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-fa3631bc-06da-403b-9be2-0645e1ea6738 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.178099 Jun 15 10:34:29.312593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 202/425] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:29 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:30.181906 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:30.182509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:30.188894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:30.189576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:30.190348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:30.190782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:30.325280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:30.330358 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:30.330946 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:30.335428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fc62c9bf-b594-4512-b0f2-c932b1416bf2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.157439 Jun 15 10:34:30.337313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 224/426] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:30 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:30.338417 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:30.339173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:30.340160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:30.340806 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:30.481929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:30.490882 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:30.492551 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:30.493710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-de7e67f7-251c-4bb1-b9c2-3fc5ab28bedb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.167558 Jun 15 10:34:30.494491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 203/427] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:30 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:31.354234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:31.354828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:31.361866 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.362429 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.363406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.363842 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.367295 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:31.502940 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:31.511693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:31.512291 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:31.513180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ab121aed-95e0-4a22-9514-0a74e5dbff7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.163260 Jun 15 10:34:31.513844 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 225/428] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:31 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:31.519036 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.519510 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.520305 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:31.520730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:31.650527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:31.659247 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:31.660731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:31.661869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4d9f8ae9-d771-4c80-887a-a308be38d831 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.154072 Jun 15 10:34:31.662408 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 204/429] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:31 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:32.529890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:32.530493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:32.536960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.537406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.538162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.538601 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.663984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:32.671893 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c98c7334-9601-4fa5-8e80-7c592a3ef0b7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.146122 Jun 15 10:34:32.672453 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 226/430] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:32 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:32.680571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:32.681249 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:32.687709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.688297 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.689389 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:32.689830 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:32.818568 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:32.827234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:32.828740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:32.829895 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9044e763-537d-4835-8869-06389d3cec3e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.153662 Jun 15 10:34:32.830446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 205/431] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:32 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:33.688286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:33.688892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:33.695452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.696397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.697153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.697598 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.828596 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:33.836565 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-eac1443f-3986-480b-90c1-2ce0ed6363d4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.152039 Jun 15 10:34:33.837134 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 227/432] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:33 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:33.847997 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:33.848591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:33.855797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.856246 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:33.857066 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:33.857517 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.023446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:34.032079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:34.033552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:34.034687 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2628f446-3bff-4ac5-8c1b-8a55cd3650df tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.190500 Jun 15 10:34:34.035265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 206/433] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:33 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:34.853927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:34.854533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:34.861071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.861517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.862275 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:34.862709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:34.991296 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:35.000063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0b574d82-39bc-4694-a925-fdfd8675243f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.150537 Jun 15 10:34:35.002448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 228/434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:34 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:35.053444 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:35.053968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:35.061438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.061941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.062702 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:35.063156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:35.194439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:35.203258 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:35.204727 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:35.205896 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2d57be60-afd1-4cb5-a602-ba81eda993b7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.157020 Jun 15 10:34:35.206435 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 207/435] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:35 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:36.017276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:36.017878 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:36.024531 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.024976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.025729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.026155 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.114848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:36.115580 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:36.122523 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.122965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.123753 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.124180 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.158811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:36.167256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f9799c9d-64e7-4511-964a-a84bb3913526 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.153632 Jun 15 10:34:36.168063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 229/436] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:36 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:36.224859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:36.225456 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:36.232037 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.232482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.233248 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:36.233675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:36.257898 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:36.266085 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d650e43e-92e8-4d75-9a61-6eba2e16d10b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1594 microversion: 2.1 time: 0.154913 Jun 15 10:34:36.266873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 208/437] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:36 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:36.373260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:36.381664 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:36.383430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:36.384787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-86e50768-7bd9-4eff-aca0-6e0bd3ab5512 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.163910 Jun 15 10:34:36.385336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 230/438] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:36 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:37.184605 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:37.185251 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:37.191841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.192287 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.193054 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.193486 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.198258 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:37.326457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:37.334824 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ae36bfdc-3e5e-4f48-adf4-4fa4057c4355 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.154531 Jun 15 10:34:37.335431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 209/439] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:37 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:37.403058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:37.403707 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:37.410591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.411037 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.411827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.412255 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.607701 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:37.616877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:37.618923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:37.620115 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-34dbe935-f11e-47d2-9e41-576bbcfe9fd2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.221035 Jun 15 10:34:37.620672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 231/440] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:37 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:37.971457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:37.971866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:37.977929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.978371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:37.979161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:37.979593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.003228 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-24def5ef-fc3e-4fae-8b3c-ab4e053bad79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/ips" status: 200 len: 151 microversion: 2.1 time: 0.035719 Jun 15 10:34:38.003795 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 210/441] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:34:37 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:38.014714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1532ea84-3027-42af-bdc3-fddb5622124c"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:38.015872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.021900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.022354 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.023132 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.023574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.101570 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Invalid volume: volume 1532ea84-3027-42af-bdc3-fddb5622124c is already attached to instances: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: POST /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/os-volume_attachments HTTP/1.1 Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 74 Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:34:38.103807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {"volumeAttachment": {"volumeId": "1532ea84-3027-42af-bdc3-fddb5622124c"}} Jun 15 10:34:38.105412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Invalid volume: volume 1532ea84-3027-42af-bdc3-fddb5622124c is already attached to instances: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'server_id': '6e49255f-b081-437b-9505-114a5239096e', 'body': {'volumeAttachment': {'volumeId': '1532ea84-3027-42af-bdc3-fddb5622124c'}}} Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1532ea84-3027-42af-bdc3-fddb5622124c is already attached to instances: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:38.106350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1532ea84-3027-42af-bdc3-fddb5622124c is already attached to instances: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:38.107798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1532ea84-3027-42af-bdc3-fddb5622124c is already attached to instances: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 400 to user: Invalid volume: volume 1532ea84-3027-42af-bdc3-fddb5622124c is already attached to instances: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:34:38.109256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2b6bfae7-54d9-47f2-81bf-8bc95fb0da0f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094538 Jun 15 10:34:38.109783 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 232/442] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:34:38 2022] POST /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:34:38.114134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.114633 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.121394 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.121845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.122602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.123038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.147475 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:34:38.244519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9f897154-3f4c-4e45-8ba1-ab219d2e17f3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 204 len: 0 microversion: 2.1 time: 0.133655 Jun 15 10:34:38.245543 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 211/443] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:34:38 2022] DELETE /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:34:38.253371 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.253992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.261411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.262257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.263294 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.264081 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.299887 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-cceef9fc-f2c5-428c-8974-926f2d10bf3d req-68bc9a3c-d0f8-4559-8936-5bab21422905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:38.310608 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-cceef9fc-f2c5-428c-8974-926f2d10bf3d req-68bc9a3c-d0f8-4559-8936-5bab21422905 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.311513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-cceef9fc-f2c5-428c-8974-926f2d10bf3d req-68bc9a3c-d0f8-4559-8936-5bab21422905 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.325391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-cceef9fc-f2c5-428c-8974-926f2d10bf3d req-68bc9a3c-d0f8-4559-8936-5bab21422905 service nova] Creating event network-changed:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:34:38.331994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-cceef9fc-f2c5-428c-8974-926f2d10bf3d req-68bc9a3c-d0f8-4559-8936-5bab21422905 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035956 Jun 15 10:34:38.332983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 212/444] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:34:38.352364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-e16054df-28c0-4d2b-b532-1cd5ae523871 req-020c1c59-7267-430b-b03c-eb8826182c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "name": "network-vif-plugged", "status": "completed", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:38.363233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-e16054df-28c0-4d2b-b532-1cd5ae523871 req-020c1c59-7267-430b-b03c-eb8826182c4c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.364057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-e16054df-28c0-4d2b-b532-1cd5ae523871 req-020c1c59-7267-430b-b03c-eb8826182c4c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.377590 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-e16054df-28c0-4d2b-b532-1cd5ae523871 req-020c1c59-7267-430b-b03c-eb8826182c4c service nova] Creating event network-vif-plugged:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:34:38.384669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-e16054df-28c0-4d2b-b532-1cd5ae523871 req-020c1c59-7267-430b-b03c-eb8826182c4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042707 Jun 15 10:34:38.385660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 213/445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:38.392431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.393585 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.403297 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.404097 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.405366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.406021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.439345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.449022 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a1d998fb-f106-4df5-847f-7193ccd7c2c2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1683 microversion: 2.1 time: 0.199533 Jun 15 10:34:38.449601 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 233/446] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:38.611355 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.620414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-995664cf-6589-42af-a209-fc8278fa5e27 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.233270 Jun 15 10:34:38.623142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 214/447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:38.638192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:38.638877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:38.645167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.645619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.646380 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:38.646817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:38.803308 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.812447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.814326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:38.816743 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-07766e41-b74f-46eb-b587-f1f8b2e7dbaa tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.182719 Jun 15 10:34:38.817417 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 234/448] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:38 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:39.418233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1954660974"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:39.419369 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.425532 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.425974 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.426720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.427172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.473143 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.474034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.482450 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.482904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.484240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.484958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.570447 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.network.security_group_api [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Adding security group 62a3b29d-809d-4c70-b47f-061dc9e5714f to port 700c7452-e992-4ca6-b384-90723c15324d Jun 15 10:34:39.632476 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:39.640569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6d2f39f8-2964-4a51-8714-53ae3a68a894 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1683 microversion: 2.1 time: 0.171271 Jun 15 10:34:39.641130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 235/449] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:39.645539 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.646336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.652185 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.652636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.653394 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.653829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.790576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:39.800565 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-89500328-6cf5-488a-8953-2756f1798ebc tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.158456 Jun 15 10:34:39.801129 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 236/450] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:39.835465 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:39.836071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:39.842417 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.842944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.843824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.844323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.922884 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5d8e0983-4a3b-4c8e-b542-a17215bcb6be tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/action" status: 202 len: 0 microversion: 2.1 time: 0.509115 Jun 15 10:34:39.926379 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 215/451] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:34:39 2022] POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:34:39.935015 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-1b7fe2d7-3340-4a1c-89fd-5f808e5b031e req-8b0c373d-41d6-4e30-a47b-f43a1cb4bf3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:39.946659 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1b7fe2d7-3340-4a1c-89fd-5f808e5b031e req-8b0c373d-41d6-4e30-a47b-f43a1cb4bf3b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:39.947358 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1b7fe2d7-3340-4a1c-89fd-5f808e5b031e req-8b0c373d-41d6-4e30-a47b-f43a1cb4bf3b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:39.988419 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-1b7fe2d7-3340-4a1c-89fd-5f808e5b031e req-8b0c373d-41d6-4e30-a47b-f43a1cb4bf3b service nova] Creating event network-changed:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:34:39.992913 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:39.997758 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-1b7fe2d7-3340-4a1c-89fd-5f808e5b031e req-8b0c373d-41d6-4e30-a47b-f43a1cb4bf3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065785 Jun 15 10:34:39.999146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 216/452] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:40.003048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:40.004795 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:40.006307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0a18e824-b203-4bd7-bc8f-307b984455f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.174888 Jun 15 10:34:40.007570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.008697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.016592 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 237/453] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:34:40.020337 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.020786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.021569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.022011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.202864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:40.210879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-870b228a-b17a-4c74-bb8f-254ee5609699 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1641 microversion: 2.1 time: 0.210127 Jun 15 10:34:40.211969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 217/454] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:39 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1641 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:40.653429 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:34:40.655214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Wed Jun 15 10:34:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e (ip 10.222.0.49) !!! Jun 15 10:34:40.659481 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.660260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.669616 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.670084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.670956 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.673418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.818813 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:40.820223 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:40.828170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.828478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.829968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:40.830527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:40.842068 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:40.851206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-221f70eb-d43e-4045-9e7d-fb79e30f4a12 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1683 microversion: 2.1 time: 0.196311 Jun 15 10:34:40.855280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 238/455] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:40 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:41.024956 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:41.025743 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:41.032166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.032612 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.033370 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.033807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.169927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:41.178478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:41.180610 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:41.181796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5f6644df-30e6-4886-ad22-fb46c8ba43b9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.160916 Jun 15 10:34:41.182351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 239/456] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:41 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:41.203309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:41.211477 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a6c6a6e6-588b-4a83-86a8-1b88788c6647 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.397318 Jun 15 10:34:41.212030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 218/457] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:40 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:41.870050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:41.870759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:41.877338 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.877864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.878710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:41.879235 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:41.946679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:41.955705 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7972cc95-d37c-4b66-b59b-83982c7905cb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1616 microversion: 2.1 time: 0.089393 Jun 15 10:34:41.956641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 240/458] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:41 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1616 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:42.020690 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-b521ebda-6aa5-42c6-ba42-e75018d04dff req-c6aef955-438e-450b-a06d-f296010f419b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e49255f-b081-437b-9505-114a5239096e", "name": "network-vif-deleted", "tag": "48f9266a-92e9-4fe2-a1e4-0ad05a509b70"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:42.030150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-b521ebda-6aa5-42c6-ba42-e75018d04dff req-c6aef955-438e-450b-a06d-f296010f419b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.030597 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-b521ebda-6aa5-42c6-ba42-e75018d04dff req-c6aef955-438e-450b-a06d-f296010f419b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.042239 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-b521ebda-6aa5-42c6-ba42-e75018d04dff req-c6aef955-438e-450b-a06d-f296010f419b service nova] Creating event network-vif-deleted:48f9266a-92e9-4fe2-a1e4-0ad05a509b70 for instance 6e49255f-b081-437b-9505-114a5239096e on hv-cinder-84349 Jun 15 10:34:42.049710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-b521ebda-6aa5-42c6-ba42-e75018d04dff req-c6aef955-438e-450b-a06d-f296010f419b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Jun 15 10:34:42.049710 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 219/459] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:42.199494 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:42.200105 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:42.206039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.206487 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.207284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.207713 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.234780 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:42.236737 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:42.249484 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.251178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.252938 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.254034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.346951 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:42.350181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:42.359360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:42.361010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:42.362730 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-21853b0d-a652-49b2-95d7-5d6d2ce8a6bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.167548 Jun 15 10:34:42.374140 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 241/460] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:42 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:42.425877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:42.434392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3de3d014-6eae-4148-9cde-df105b093bb7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.208976 Jun 15 10:34:42.436279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 220/461] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:42 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:42.973635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:42.974226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:42.981638 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.982316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:42.983278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:42.983864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.084861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.094351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2d6d286e-721b-4db1-aff1-75a97bd7d31b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 200 len: 1327 microversion: 2.1 time: 0.124420 Jun 15 10:34:43.095242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 242/462] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:42 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:43.380872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:43.381503 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:43.388666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.389284 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.390052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.390488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.450953 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:43.451662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:43.458347 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.459038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.460080 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:43.460770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:43.600958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.617406 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.619497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.621671 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-93ad6a61-ccec-4988-80a6-c3d83222b326 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1809 microversion: 2.20 time: 0.244089 Jun 15 10:34:43.634830 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 221/463] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:43 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:43.650243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:43.660070 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7bbe0dd2-7945-4953-9abc-227c7af644d7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.212780 Jun 15 10:34:43.661066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 243/464] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:43 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:44.111708 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.112231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.118756 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.119218 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.119966 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.120400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.135118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e HTTP/1.1 Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:34:44.136697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:34:44.138160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '6e49255f-b081-437b-9505-114a5239096e'} Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:34:44.139025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:34:44.140459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:34:44.142030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:34:44.142030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-903333ed-2a89-4c87-8dad-ebcd08671f9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 404 len: 111 microversion: 2.1 time: 0.030167 Jun 15 10:34:44.142030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 222/465] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:34:44.147261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-147f4ceb-457f-44e7-a5c8-bb6de3885c19 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '.version_select at 0x7feb3ab8c040>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.165920 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-147f4ceb-457f-44e7-a5c8-bb6de3885c19 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229680394" status: 202 len: 0 microversion: 2.1 time: 0.022430 Jun 15 10:34:44.166468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 244/466] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jun 15 10:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229680394 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:34:44.640711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.641312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.648999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.649824 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.650592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.651019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.676629 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.677233 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.683579 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.684236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.685167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.685778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.804215 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:44.813122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:44.814709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:44.815983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2e5bcf45-386f-4e2f-8f05-78ffa1a1f44c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1796 microversion: 2.20 time: 0.179297 Jun 15 10:34:44.816604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 223/467] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1796 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:34:44.905299 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:44.913360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-394dccfe-85a8-445d-8a90-0ffad516758d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.240637 Jun 15 10:34:44.914016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 245/468] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:44 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:44.947981 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:44.948443 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:44.954341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.954785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:44.955569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:44.956006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:45.077680 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lazy-loading 'services' on Instance uuid 1af6cc0a-d588-4a98-a82a-56d49cd2c55c {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:34:45.189702 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6f6a2564-bec1-442b-b32e-fb51fd8ee1aa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments/1532ea84-3027-42af-bdc3-fddb5622124c" status: 202 len: 0 microversion: 2.1 time: 0.245944 Jun 15 10:34:45.190288 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 224/469] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:34:44 2022] DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments/1532ea84-3027-42af-bdc3-fddb5622124c => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:34:45.199384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:45.200280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:45.208094 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:45.208669 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:45.209650 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:45.210182 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:45.240285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fbd2ea06-f3a1-4cd1-bfcd-b1e6c2c9973b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Jun 15 10:34:45.240835 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 246/470] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:45 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:45.931430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:45.932259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:45.939327 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:45.939778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:45.940538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:45.940976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:46.072130 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:46.080062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9c184b33-47a6-4da7-86b6-848239da0f55 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.153598 Jun 15 10:34:46.080621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 225/471] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:45 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:46.252523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:46.253476 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:46.260139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:46.260585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:46.261348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:46.261780 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:46.293844 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fe3fbad5-9b98-4d47-b841-d71fd7834fd1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Jun 15 10:34:46.294463 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 247/472] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:46 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:47.097084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:47.097636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:47.104576 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.105019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.105767 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.106199 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.232839 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:47.240937 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f5b3787f-7119-48a9-8bdb-c48351bb5968 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.147727 Jun 15 10:34:47.241506 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 226/473] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:47 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:47.305903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:47.306819 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:47.313277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.313732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.314491 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.314922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.342382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a76ba16e-9630-4669-a4b2-af1c22f0633b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041011 Jun 15 10:34:47.342921 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 248/474] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:34:47 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:34:47.400721 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:47.401256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:47.407722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.408174 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.408926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.409361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.427599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:47.435883 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:34:47.509854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f03457ca-e8bb-4d14-b042-e8aa07549526 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 204 len: 0 microversion: 2.1 time: 0.113263 Jun 15 10:34:47.510447 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 227/475] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:34:47 2022] DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:34:47.518585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:47.519272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:47.521111 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:47.527486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.527938 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.528698 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:47.529403 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:47.657195 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:47.665288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8f24efae-357b-4617-849e-79da4d06cf2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1680 microversion: 2.1 time: 0.149958 Jun 15 10:34:47.665839 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 249/476] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:47 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:48.259546 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:48.260161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:48.266723 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:48.267208 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:48.267972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:48.268437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:48.395812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:48.403752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ccb0b6c0-0cf0-4366-826d-9adf60d451ca tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1724 microversion: 2.1 time: 0.149182 Jun 15 10:34:48.404571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 228/477] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:48 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:48.682885 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:48.683519 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:48.690007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:48.690448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:48.691227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:48.691659 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:48.823568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:48.831066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-51cd6ede-aed8-46ee-9079-a58c030da81b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1680 microversion: 2.1 time: 0.152706 Jun 15 10:34:48.831644 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 250/478] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:48 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:49.420971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:49.421609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:49.428201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.428649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.429404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.429837 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.620605 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:49.628615 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bdec37b8-c44d-49cd-8840-52aff6ddb64c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1701 microversion: 2.1 time: 0.211568 Jun 15 10:34:49.629178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 229/479] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:49 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1701 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:49.645562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-47b7ce3e-db07-4c61-afc0-325be8f907b8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:49.652547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-47b7ce3e-db07-4c61-afc0-325be8f907b8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.653000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-47b7ce3e-db07-4c61-afc0-325be8f907b8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.713973 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-47b7ce3e-db07-4c61-afc0-325be8f907b8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Going to try to start instance {{(pid=118864) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 10:34:49.756714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-47b7ce3e-db07-4c61-afc0-325be8f907b8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action" status: 202 len: 0 microversion: 2.1 time: 0.114784 Jun 15 10:34:49.757308 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 251/480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:34:49 2022] POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:34:49.766046 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:49.766647 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:49.772824 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.773272 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.774232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.774674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.848521 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:49.849539 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:49.855972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.856431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.857203 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:49.857643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:49.990884 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:49.999675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-033170fa-559a-408d-9606-2184d0b37ffb tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1680 microversion: 2.1 time: 0.155349 Jun 15 10:34:50.000242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 252/481] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:49 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:50.049300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:50.057848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-739fc41c-83a0-4de8-b183-80ed88f7d011 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1710 microversion: 2.1 time: 0.295644 Jun 15 10:34:50.058418 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 230/482] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:49 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1710 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:51.021079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:51.022438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:51.026350 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-cd83a2eb-00e3-45d9-ba09-00e9739785ef req-3108a209-0364-4f53-aaa8-4454d8163cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af6cc0a-d588-4a98-a82a-56d49cd2c55c", "name": "network-vif-deleted", "tag": "093ff4e7-eb5f-4b43-9bc3-63863d7ab03e"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:51.033603 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:51.035215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:51.035889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-cd83a2eb-00e3-45d9-ba09-00e9739785ef req-3108a209-0364-4f53-aaa8-4454d8163cf5 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:51.035889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-cd83a2eb-00e3-45d9-ba09-00e9739785ef req-3108a209-0364-4f53-aaa8-4454d8163cf5 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:51.037362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:51.038177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:51.047974 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-cd83a2eb-00e3-45d9-ba09-00e9739785ef req-3108a209-0364-4f53-aaa8-4454d8163cf5 service nova] Creating event network-vif-deleted:093ff4e7-eb5f-4b43-9bc3-63863d7ab03e for instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c on hv-cinder-84349 Jun 15 10:34:51.054006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-cd83a2eb-00e3-45d9-ba09-00e9739785ef req-3108a209-0364-4f53-aaa8-4454d8163cf5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 Jun 15 10:34:51.059365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 231/483] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:34:51.076821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:51.077752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:51.086984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:51.087543 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:51.088518 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:51.089043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:51.115671 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:51.123542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f492f590-6287-47f0-aead-4785cdd4e0a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1612 microversion: 2.1 time: 0.109346 Jun 15 10:34:51.134176 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 253/484] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:51 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:51.231414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:51.239482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4daa4c06-58a6-4341-a219-9adb48b8f28d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1710 microversion: 2.1 time: 0.167156 Jun 15 10:34:51.240034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 232/485] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:51 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:34:52.140673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:52.141257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:52.147754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:52.148196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:52.149449 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:52.149877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:52.180327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:52.180765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:52.181198 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lazy-loading 'fault' on Instance uuid 1af6cc0a-d588-4a98-a82a-56d49cd2c55c {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:34:52.226040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:52.234125 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-42057c71-4c90-4f05-93ee-cee09b10d8a4 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 200 len: 1330 microversion: 2.1 time: 0.097289 Jun 15 10:34:52.234687 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 254/486] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:52 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:52.256728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:52.257335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:52.260317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:52.265487 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:52.265928 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:52.266678 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:52.267128 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:52.390862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:52.399444 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d55ba520-1099-44cf-a42b-c78048bbe754 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1714 microversion: 2.1 time: 0.145829 Jun 15 10:34:52.399999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 233/487] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:52 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1714 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:53.250857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:53.251556 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:53.258134 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:53.259190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:53.259945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:53.260378 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:53.273557 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c HTTP/1.1 Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:34:53.275218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:34:53.276703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '1af6cc0a-d588-4a98-a82a-56d49cd2c55c'} Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:34:53.277538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:34:53.279249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:34:53.280805 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:34:53.280805 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-74814142-7c74-4794-a1c6-8bd149d2c85f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 404 len: 111 microversion: 2.1 time: 0.029568 Jun 15 10:34:53.280805 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 255/488] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:53 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:34:53.285361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-81f9a43f-9957-4de2-bd95-40f9bcd8cead tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '.version_select at 0x7feb3abda820>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:53.303888 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-81f9a43f-9957-4de2-bd95-40f9bcd8cead tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-690229438" status: 202 len: 0 microversion: 2.1 time: 0.022260 Jun 15 10:34:53.304458 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 234/489] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jun 15 10:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-690229438 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:34:53.899786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dd876f6a-5444-46b8-8ed1-871d1234591f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: .version_select at 0x7feb3aa87e50>, body: {"keypair": {"name": "tempest-keypair-1855293030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoGE1olFhg/MuXRXfpS3hGrPSqExdRgPNg4/cWQ1YVAOHV5XCzPGHFJTtdFHpSPQ1pLu6H9d7z29aQz5uAhPlsk5gVMCvxwXXpVyZ/m8PHKeBTPFQekZYBDuNmI9Q1NLA=="}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:53.914372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-dd876f6a-5444-46b8-8ed1-871d1234591f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:34:53.918904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-dd876f6a-5444-46b8-8ed1-871d1234591f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:34:53.939848 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dd876f6a-5444-46b8-8ed1-871d1234591f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044021 Jun 15 10:34:53.940421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 256/490] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:34:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:55.378093 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2124213408", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56f473a9-939b-4bd2-a5d0-e5eaaaa25745"}], "security_groups": [{"name": "tempest-securitygroup--34339414"}], "key_name": "tempest-keypair-1855293030", "user_data": "}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:55.476007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] validate_networks() for [('56f473a9-939b-4bd2-a5d0-e5eaaaa25745', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:34:55.830365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:34:55.830791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:34:55.831295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:34:55.831770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:34:55.832254 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:34:55.841362 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:55.841808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:55.842592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:55.843023 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:55.860188 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:34:55.864120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:34:55.875390 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:34:55.877599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:34:55.921591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-785993dd-b9f4-4e3c-a9e4-651fb527a80b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.548326 Jun 15 10:34:55.922222 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 235/491] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:34:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:34:55.933205 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-db28132d-fa0d-4095-92c3-536433441924 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:55.933910 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-db28132d-fa0d-4095-92c3-536433441924 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:55.988076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-db28132d-fa0d-4095-92c3-536433441924 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:55.995442 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-db28132d-fa0d-4095-92c3-536433441924 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1242 microversion: 2.1 time: 0.067185 Jun 15 10:34:55.995979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 257/492] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:55 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:57.013989 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:57.014587 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:57.021162 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:57.021600 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:57.022361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:57.022791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:57.096093 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:57.103513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-89222693-0b86-4cc7-ac97-932f3f9f5786 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1312 microversion: 2.1 time: 0.094864 Jun 15 10:34:57.104067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 236/493] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:57 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:58.120503 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:58.121149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:58.128181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:58.128633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:58.129411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:58.129919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:58.266697 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:58.275405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0165f1e6-d541-4501-b7e8-4e9408021833 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.158756 Jun 15 10:34:58.276876 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 258/494] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:58 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:34:58.501247 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-0125876c-3fd1-4f4a-a5fc-4e7c74de1744 req-29b1653f-8415-4db8-bf0e-33a31160d9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41bb315-40ff-4372-90e4-b8f405548765", "tag": "3566e96c-46a9-4c41-af85-9632202f0396"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:34:58.511782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-0125876c-3fd1-4f4a-a5fc-4e7c74de1744 req-29b1653f-8415-4db8-bf0e-33a31160d9e0 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:58.512240 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-0125876c-3fd1-4f4a-a5fc-4e7c74de1744 req-29b1653f-8415-4db8-bf0e-33a31160d9e0 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:58.524118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-0125876c-3fd1-4f4a-a5fc-4e7c74de1744 req-29b1653f-8415-4db8-bf0e-33a31160d9e0 service nova] Creating event network-changed:3566e96c-46a9-4c41-af85-9632202f0396 for instance c41bb315-40ff-4372-90e4-b8f405548765 on hv-cinder-84349 Jun 15 10:34:58.530502 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-0125876c-3fd1-4f4a-a5fc-4e7c74de1744 req-29b1653f-8415-4db8-bf0e-33a31160d9e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033444 Jun 15 10:34:58.531049 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 237/495] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:34:59.293005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:34:59.293600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:34:59.300151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:59.300595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:59.301340 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:34:59.301768 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:34:59.431212 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:34:59.438629 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-26f03c98-93bc-4b34-be9a-bf7ed65fc853 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.149420 Jun 15 10:34:59.439208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 259/496] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:34:59 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:00.456652 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:00.457341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:00.464160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:00.464652 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:00.465404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:00.465833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:00.631804 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:00.639908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-40487ccb-4b4c-4767-8a06-4f83ea909341 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.187927 Jun 15 10:35:00.640472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 238/497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:00 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:01.655960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:01.656574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:01.663231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:01.663687 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:01.664447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:01.664891 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:01.795353 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:01.797733 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:01.804076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a4d2fe56-30a8-4ca8-9012-942ba14cfd97 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.152220 Jun 15 10:35:01.804637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 260/498] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:01 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:02.821395 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:02.822717 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:02.829207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:02.829644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:02.830389 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:02.830816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:02.839231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:02.840283 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:02.848441 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:02.848889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:02.849660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:02.850097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:02.923957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-eceda0dc-82fa-4f4f-82ff-cad33b36c41c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/action" status: 202 len: 0 microversion: 2.1 time: 0.088903 Jun 15 10:35:02.924991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 261/499] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:35:02 2022] POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:35:02.933317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:02.934023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:02.941215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:02.941215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:02.941769 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:02.942193 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:02.981318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:02.997970 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-92f9fdd0-a498-4caa-ac78-9bfce581d89f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.180342 Jun 15 10:35:02.998696 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 239/500] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:02 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:03.096555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:03.105919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3e2988ef-4331-458a-8fd3-8cf8c1cef0ab tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1752 microversion: 2.1 time: 0.177146 Jun 15 10:35:03.107121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 262/501] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:02 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:04.015225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:04.015827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:04.022333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:04.022775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:04.023553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:04.023984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:04.123604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:04.124204 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:04.130697 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:04.131179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:04.131936 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:04.132364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:04.153630 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:04.161426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3f794bd3-3d2b-47aa-a6cb-95542cab83ca tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.150076 Jun 15 10:35:04.161990 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 240/502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:04 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:04.271124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:04.279895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b2978e0b-3c9a-4cec-a9e6-401f6e6e9c6c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.160075 Jun 15 10:35:04.280493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 263/503] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:04 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:04.406990 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-a434ff45-da59-4749-971b-50568823e8bf req-c7075649-527a-474d-8d3c-b4ef27c09a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41bb315-40ff-4372-90e4-b8f405548765", "name": "network-vif-plugged", "status": "completed", "tag": "3566e96c-46a9-4c41-af85-9632202f0396"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:04.416434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-a434ff45-da59-4749-971b-50568823e8bf req-c7075649-527a-474d-8d3c-b4ef27c09a04 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:04.416434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-a434ff45-da59-4749-971b-50568823e8bf req-c7075649-527a-474d-8d3c-b4ef27c09a04 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:04.427532 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-a434ff45-da59-4749-971b-50568823e8bf req-c7075649-527a-474d-8d3c-b4ef27c09a04 service nova] Creating event network-vif-plugged:3566e96c-46a9-4c41-af85-9632202f0396 for instance c41bb315-40ff-4372-90e4-b8f405548765 on hv-cinder-84349 Jun 15 10:35:04.432217 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-a434ff45-da59-4749-971b-50568823e8bf req-c7075649-527a-474d-8d3c-b4ef27c09a04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029294 Jun 15 10:35:04.432989 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 241/504] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:05.178508 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:05.179033 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:05.185578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:05.186039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:05.186776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:05.187236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:05.298715 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:05.299428 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:05.305662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:05.306105 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:05.306852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:05.307309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:05.319301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:05.326920 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4cfda721-d06f-4036-8bfa-9d1c7ed39dac tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.152289 Jun 15 10:35:05.327537 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 264/505] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:05 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:05.447109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:05.455453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-67180282-f98e-4171-b75c-ac3db8a0b63a tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.161433 Jun 15 10:35:05.456004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 242/506] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:05 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:06.343871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:06.344504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:06.346489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=6 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:06.352202 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:06.352655 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:06.353427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:06.353864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:06.472002 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:06.472598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:06.474554 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:06.475371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:06.480463 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:06.482558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:06.482995 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:06.483783 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:06.484210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:06.488281 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-76692e10-cbbc-48b9-806c-dd4380614141 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1366 microversion: 2.1 time: 0.148345 Jun 15 10:35:06.488835 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 265/507] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:06 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:06.621963 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:06.629914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-19e49c29-50c8-406c-9320-358721f3d5c9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.161683 Jun 15 10:35:06.630470 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 243/508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:06 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:07.505337 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:07.505851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:07.512470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:07.512919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:07.513679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:07.514110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:07.643046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:07.647047 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:07.647672 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:07.650545 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6588852d-f13d-4743-be96-6a3f036f8775 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1556 microversion: 2.1 time: 0.149141 Jun 15 10:35:07.651699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 266/509] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:07 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:07.654983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:07.655466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:07.656222 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:07.656647 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:07.666968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:07.667556 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:07.673557 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:07.674083 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:07.674915 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:07.675384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:07.751171 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-11b4d06f-c8b9-4fee-a1cf-f2367ca59536 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087730 Jun 15 10:35:07.751871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 267/510] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:35:07 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:35:07.796332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:07.804359 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-436ef327-f054-4697-aab4-cf13fc8f5d6e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.160991 Jun 15 10:35:07.804929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 244/511] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:07 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:08.298251 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8de59cf2-0d0d-40ca-8768-a8bfedd0783d"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:08.299345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:08.305451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:08.305904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:08.306672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:08.307625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:08.597143 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f59a3fb4-f720-4f16-8c60-2fae758c19d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302825 Jun 15 10:35:08.598243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 268/512] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:35:08 2022] POST /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:08.664867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-9ac8e93c-9f47-4666-b93a-a937dd435561 req-5ea0db24-fca8-4d37-b16b-fdb55b40ba13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41bb315-40ff-4372-90e4-b8f405548765", "tag": "3566e96c-46a9-4c41-af85-9632202f0396"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:08.674402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-9ac8e93c-9f47-4666-b93a-a937dd435561 req-5ea0db24-fca8-4d37-b16b-fdb55b40ba13 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:08.674915 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-9ac8e93c-9f47-4666-b93a-a937dd435561 req-5ea0db24-fca8-4d37-b16b-fdb55b40ba13 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:08.689206 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-9ac8e93c-9f47-4666-b93a-a937dd435561 req-5ea0db24-fca8-4d37-b16b-fdb55b40ba13 service nova] Creating event network-changed:3566e96c-46a9-4c41-af85-9632202f0396 for instance c41bb315-40ff-4372-90e4-b8f405548765 on hv-cinder-84349 Jun 15 10:35:08.694377 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-9ac8e93c-9f47-4666-b93a-a937dd435561 req-5ea0db24-fca8-4d37-b16b-fdb55b40ba13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033200 Jun 15 10:35:08.695130 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 245/513] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:08.821281 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:08.822119 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:08.830016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:08.831114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:08.832007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:08.832631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:08.983411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:08.992128 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3fd010d4-8366-4353-b34e-c8f53fd07e4c tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.174902 Jun 15 10:35:08.993142 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 269/514] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:08 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:10.010699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:10.011425 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:10.017615 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:10.018055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:10.018798 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:10.019271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:10.161093 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:10.164563 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:10.169743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6197c8c4-1d85-4d15-a722-cd2c158d7c1e tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.164145 Jun 15 10:35:10.170296 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 246/515] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:10 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:11.186103 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:11.186708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:11.193226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:11.193670 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:11.194420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:11.194850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:11.332279 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:11.340247 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-503cb712-3f8e-47e7-8f36-39e417315f9d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.158461 Jun 15 10:35:11.340809 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 270/516] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:11 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:12.356580 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:12.357174 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:12.364198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:12.364637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:12.365377 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:12.365806 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:12.503042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:12.511750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1e9c400b-f0c7-453d-810b-26c8794b4bd9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.159553 Jun 15 10:35:12.512343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 247/517] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:12 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:13.528818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:13.529421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:13.536052 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:13.536493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:13.537242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:13.537667 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:13.680461 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:13.689088 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3e4b46a7-4da8-4b1e-a0c0-e368299e0ed5 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.164482 Jun 15 10:35:13.689639 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 271/518] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:13 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:14.706097 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:14.706713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:14.713892 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:14.714338 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:14.715111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:14.715546 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:14.857924 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:14.865902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c86ccb5e-decb-401e-8ff5-21afa58ceccd tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.163869 Jun 15 10:35:14.866484 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 248/519] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:14 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:15.883244 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:15.883854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:15.890948 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:15.891436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:15.892197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:15.892637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:16.033890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:16.041807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b41463f7-1b45-46d1-89e6-7c0e381efa78 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.162403 Jun 15 10:35:16.042366 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 272/520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:15 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:16.075779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:16.076713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:16.083142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:16.083594 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:16.084353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:16.084786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:16.107517 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'flavor' on Instance uuid 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:35:16.227779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5cff9ca3-edec-412f-a331-fd48474f0d54 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/action" status: 200 len: 32 microversion: 2.1 time: 0.156386 Jun 15 10:35:16.228385 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 249/521] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:35:16 2022] POST /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:35:16.237302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:16.238090 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:16.244632 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:16.245084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:16.246332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:16.246763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:16.382740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:16.391559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-761c9cff-8ce6-457e-8532-8892e5539468 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.158035 Jun 15 10:35:16.392304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 273/522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:16 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:17.059050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:17.059785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:17.066063 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:17.066512 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:17.067301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:17.067742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:17.206055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:17.214666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9c272a72-23a8-493c-8484-1131dd31dddc tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.159468 Jun 15 10:35:17.215255 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 250/523] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:17 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:17.409397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:17.409933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:17.416436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:17.416881 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:17.417853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:17.418324 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:17.546088 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:17.554052 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-013a5010-bf17-47ba-aacd-4a44e788b1d4 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.148614 Jun 15 10:35:17.554619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 274/524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:17 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:18.232172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:18.232802 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:18.239323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:18.239773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:18.240531 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:18.240996 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:18.380667 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:18.388677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-219ba085-d914-4a76-8908-c80385bcdcbf tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.160831 Jun 15 10:35:18.389277 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 251/525] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:18 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:18.571059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:18.571692 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:18.574120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:18.579581 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:18.580024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:18.580778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:18.581210 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:18.597293 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:18.717091 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:18.725034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0d43687b-031d-4b6d-b0a4-e189b9921827 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.157714 Jun 15 10:35:18.725597 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 275/526] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:18 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:19.406409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:19.407115 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:19.413607 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:19.414051 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:19.414804 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:19.415282 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:19.555318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:19.563210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b7246cd5-2eff-4eef-b8c9-6409ee93308d tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1757 microversion: 2.1 time: 0.161389 Jun 15 10:35:19.563829 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 252/527] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:19 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:19.741874 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:19.742493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:19.749034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:19.749480 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:19.750243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:19.750679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:19.880382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:19.888723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a829781c-2d05-4aef-8426-c65379423402 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.150951 Jun 15 10:35:19.889277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 276/528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:19 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:20.580083 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:20.580611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:20.587137 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:20.587590 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:20.588344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:20.588808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:20.729449 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:20.737880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7650f2d9-c4f7-4ea1-9987-7099c19e9126 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1760 microversion: 2.1 time: 0.161716 Jun 15 10:35:20.738431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 253/529] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:20 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:20.905485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:20.906024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:20.912588 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:20.913021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:20.913776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:20.914210 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:21.037781 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:21.046337 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5504d9b2-3725-451b-b9e8-32731bf47a64 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.145546 Jun 15 10:35:21.046896 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 277/530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:20 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:22.063197 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:22.063785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:22.070200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:22.070642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:22.071410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:22.071836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:22.199234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:22.207114 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-fede8a17-17ac-4470-8dd4-f924bc653784 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.147819 Jun 15 10:35:22.207657 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 254/531] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:22 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:23.224729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:23.225250 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:23.232607 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:23.233058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:23.233815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:23.234249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:23.360680 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:23.368750 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-20ee675c-c841-45ca-859e-c2644c99d978 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.147956 Jun 15 10:35:23.369318 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 278/532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:23 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:24.385565 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:24.386631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:24.389088 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:24.394614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:24.395098 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:24.395878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:24.396313 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:24.524373 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:24.532587 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-40f12ec5-aacf-4507-be6f-7f5a83604d71 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.150841 Jun 15 10:35:24.533149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 255/533] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:24 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:25.549427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:25.550034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:25.556491 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:25.556933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:25.557678 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:25.558110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:25.685952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:25.695331 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7f815a81-c6d3-482f-b984-216b8cb643e1 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.149727 Jun 15 10:35:25.696108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 279/534] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:25 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:26.173472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:26.173959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:26.180473 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.180920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.181676 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.182103 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.212591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3a782e26-9149-4d69-8ba3-e23507c0ecb0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments/817a98c3-e571-457a-81a5-22d74492c8c9" status: 200 len: 194 microversion: 2.20 time: 0.043185 Jun 15 10:35:26.213157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 256/535] 10.222.0.49 () {60 vars in 1453 bytes} [Wed Jun 15 10:35:26 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments/817a98c3-e571-457a-81a5-22d74492c8c9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:35:26.274278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:26.274772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:26.281124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.281579 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.282334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.282770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.404284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lazy-loading 'services' on Instance uuid 16e37acd-69b1-4758-8ab5-07ec67e9ae2f {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:35:26.513606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ad3c58a1-f7c6-4a44-8ba9-2e33fff8b79e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments/817a98c3-e571-457a-81a5-22d74492c8c9" status: 202 len: 0 microversion: 2.20 time: 0.243088 Jun 15 10:35:26.514230 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 280/536] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Jun 15 10:35:26 2022] DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments/817a98c3-e571-457a-81a5-22d74492c8c9 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:35:26.522612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:26.523637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:26.530107 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.530554 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.531489 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.531927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.561077 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-556179a7-597c-4522-a950-c4a2df04f92d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042356 Jun 15 10:35:26.561637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 257/537] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jun 15 10:35:26 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:35:26.713503 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:26.714226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:26.721012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.721462 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.722223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:26.722656 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:26.848776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:26.857215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-806ea8c3-12dd-4bde-91da-23448bf55f8c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.148460 Jun 15 10:35:26.857776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 281/538] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:26 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:27.572520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:27.573951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:27.580410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:27.580857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:27.581603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:27.582027 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:27.615066 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9b4f3474-43c9-4011-9271-acb50d657cef tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046460 Jun 15 10:35:27.615711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 258/539] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jun 15 10:35:27 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:35:27.874431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:27.874998 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:27.881638 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:27.882079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:27.882832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:27.883298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.013268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:28.021247 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a38ac4de-d8ba-4e5f-8337-1cc47bdc0037 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.151454 Jun 15 10:35:28.021803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 282/540] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:27 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:28.627228 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:28.628138 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:28.634643 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:28.635082 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.635851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:28.636275 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.664312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8e0bb1fc-043a-4b72-8e70-5a5e09e2fe3a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041128 Jun 15 10:35:28.664835 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 259/541] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jun 15 10:35:28 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:28.722124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:28.722619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:28.728649 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:28.729097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.729896 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:28.730854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.757583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:35:28.832772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d79eaec2-9699-467a-85f8-9ca48370496e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 204 len: 0 microversion: 2.20 time: 0.114135 Jun 15 10:35:28.833529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 283/542] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jun 15 10:35:28 2022] DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:35:28.842606 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:28.843241 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:28.849151 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:28.849589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.850332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:28.850758 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:28.974563 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:28.982473 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:28.983995 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:28.985134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-48e16327-93db-48c1-8cd9-ad5e7cb0a706 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.147090 Jun 15 10:35:28.985683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 260/543] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:28 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:35:29.038854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:29.039580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:29.046029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:29.046471 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:29.047252 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:29.047681 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:29.174073 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:29.181990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-afdaf217-0c95-4ed7-8917-c6c18f3721f9 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.147190 Jun 15 10:35:29.182487 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 284/544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:29 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:30.003273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:30.003878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:30.010367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:30.010812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:30.011611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:30.012041 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:30.030737 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:30.141126 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:30.149156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:30.150880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:30.152058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a5b444d6-0c27-4606-8e3f-43e5fa94133f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1724 microversion: 2.20 time: 0.152796 Jun 15 10:35:30.152604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 261/545] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:29 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:30.198426 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:30.199033 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:30.206164 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:30.206594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:30.207384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:30.207819 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:30.335400 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:30.343490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-69c0557a-2959-47db-9a71-1278f93689ff tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.148826 Jun 15 10:35:30.344046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 285/546] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:30 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:31.170453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:31.171067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:31.177550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:31.177991 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:31.178744 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:31.179194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:31.261259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:31.271067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:31.272182 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:31.273328 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3788de49-5bd4-40b0-8407-9da9ecbbfbc8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 200 len: 1657 microversion: 2.20 time: 0.107540 Jun 15 10:35:31.274120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 262/547] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:31 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 1657 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:31.361173 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:31.361829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:31.368632 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:31.369085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:31.369847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:31.370278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:31.500547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:31.509763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-913eca4e-a6ee-4e2a-90f5-1f6e54979ade tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.152549 Jun 15 10:35:31.510559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 286/548] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:31 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:31.523752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-b95adb90-def3-4d3d-92b2-7dc0edff6f27 req-0474eea1-41fd-4d25-8dc3-b9ee4db9f40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e37acd-69b1-4758-8ab5-07ec67e9ae2f", "name": "network-vif-deleted", "tag": "836e09e8-adcf-4089-b01c-a780a8041789"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:31.533401 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-b95adb90-def3-4d3d-92b2-7dc0edff6f27 req-0474eea1-41fd-4d25-8dc3-b9ee4db9f40a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:31.533909 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-b95adb90-def3-4d3d-92b2-7dc0edff6f27 req-0474eea1-41fd-4d25-8dc3-b9ee4db9f40a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:31.545200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-b95adb90-def3-4d3d-92b2-7dc0edff6f27 req-0474eea1-41fd-4d25-8dc3-b9ee4db9f40a service nova] Creating event network-vif-deleted:836e09e8-adcf-4089-b01c-a780a8041789 for instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f on hv-cinder-84349 Jun 15 10:35:31.550378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-b95adb90-def3-4d3d-92b2-7dc0edff6f27 req-0474eea1-41fd-4d25-8dc3-b9ee4db9f40a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030143 Jun 15 10:35:31.554538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 263/549] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:32.291981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:32.292712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:32.298841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:32.299331 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:32.300098 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:32.300531 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:32.315372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] HTTP exception thrown: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Request method failure captured: Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f HTTP/1.1 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUI_QcTjTMWGH6XgFADqiocFZRqC_uJpoTfBgEzT0iNltPrRWI9cSUNkQt3Gesw2KFm9qUMPmsTIwkh61yNMwgjSWvCiJCLo7NQzg72ggcRWoEpBqkazDZadI38HyUYZv6leolPFZH9zt_lAkxqeh083vSkreehnOSS3JEm-ruzoHo Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:35:32.317021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5dc28af73e82414d8f709e447286a962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5dc28af73e82414d8f709e447286a962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cca7cb5e7620446ebae91b1fe12bbd24 Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:35:32.318676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '16e37acd-69b1-4758-8ab5-07ec67e9ae2f'} Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:35:32.319515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:35:32.320711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:32.321850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Returning 404 to user: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:35:32.321850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-79b5de1e-d425-47dc-8369-cd063fd9a26a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 404 len: 111 microversion: 2.20 time: 0.030365 Jun 15 10:35:32.321850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 287/550] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:32 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:35:32.328461 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-29d50c18-f574-47f1-90c8-ad3c918d6770 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '.version_select at 0x7feb3ac1e280>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:32.346510 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-29d50c18-f574-47f1-90c8-ad3c918d6770 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617120641" status: 204 len: 0 microversion: 2.20 time: 0.022750 Jun 15 10:35:32.347362 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 264/551] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Jun 15 10:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617120641 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:35:32.529628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:32.530699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:32.538447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:32.538897 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:32.539822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:32.545611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:32.679225 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:32.688282 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-90b1263a-0de6-4016-8c89-51adaa84d88a tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.163979 Jun 15 10:35:32.688900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 288/552] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:32 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:32.986165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f5e0dce6-5283-4eeb-a6e6-2a1c734b4c52 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'create', calling method: .version_select at 0x7feb3abd4280>, body: {"keypair": {"name": "tempest-keypair-486971372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXGQ4fjQSDTpPA1laaVdpHlNlqegREQaAAO2hVOOW3oKE6dR1+PDr2Xw5K7P894fb2Zud0k2NdpJD9MyEf9nJJDDC9Q4dDHxM/3SH6Ic+KAS1rpgBdxfjAA7mtAwASWLg=="}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:33.000922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-f5e0dce6-5283-4eeb-a6e6-2a1c734b4c52 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for project 5dc28af73e82414d8f709e447286a962. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:35:33.004772 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-f5e0dce6-5283-4eeb-a6e6-2a1c734b4c52 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for user cca7cb5e7620446ebae91b1fe12bbd24 and project 5dc28af73e82414d8f709e447286a962. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:35:33.025677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f5e0dce6-5283-4eeb-a6e6-2a1c734b4c52 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.043409 Jun 15 10:35:33.026245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 265/553] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Jun 15 10:35:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 10:35:33.705767 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:33.706396 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:33.712810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:33.713251 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:33.714003 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:33.714436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:33.845298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:33.853260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-37f8633f-1b73-492d-9ab6-822a8a26482c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.151365 Jun 15 10:35:33.853808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 289/554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:33 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:34.317410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-924339292", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5f07d8-adfa-49e4-965f-88f44de7cd54"}], "security_groups": [{"name": "tempest-securitygroup--160615727"}], "key_name": "tempest-keypair-486971372", "user_data": "}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:34.417834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] validate_networks() for [('4d5f07d8-adfa-49e4-965f-88f44de7cd54', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:35:34.811348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:34.811853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:34.818484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:34.818922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:34.819709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:34.820140 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:34.843227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:34.906425 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lazy-loading 'services' on Instance uuid 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:35:34.991147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:35:34.991645 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:35:34.992333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:35:34.992845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:35:34.993322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:35:35.003941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:35.004485 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:35.005351 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:35.005787 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:35.024104 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for project 5dc28af73e82414d8f709e447286a962. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:35:35.028895 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Getting quotas for user cca7cb5e7620446ebae91b1fe12bbd24 and project 5dc28af73e82414d8f709e447286a962. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:35:35.042011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:35:35.044637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:35:35.094662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d9c31338-064f-4253-af18-749abd69ece7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.782060 Jun 15 10:35:35.101292 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 266/555] 10.222.0.49 () {62 vars in 1187 bytes} [Wed Jun 15 10:35:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 10:35:35.102992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:35.103627 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:35.111838 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:35.112409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:35.113266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:35.113770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:35.134144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b5af6871-5314-4f98-b256-7ca1bf7aa5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-volume_attachments/b3a70491-e6fd-482c-a973-54355b72f08e" status: 202 len: 0 microversion: 2.1 time: 0.326520 Jun 15 10:35:35.138285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 290/556] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:35:34 2022] DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-volume_attachments/b3a70491-e6fd-482c-a973-54355b72f08e => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:35:35.143767 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e5e1a88f-34aa-43b4-a06a-54516246505c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:35.144451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e5e1a88f-34aa-43b4-a06a-54516246505c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:35.203316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e5e1a88f-34aa-43b4-a06a-54516246505c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:35.219967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e5e1a88f-34aa-43b4-a06a-54516246505c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:35.221095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e5e1a88f-34aa-43b4-a06a-54516246505c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:35.222226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e5e1a88f-34aa-43b4-a06a-54516246505c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1280 microversion: 2.20 time: 0.082622 Jun 15 10:35:35.223292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 291/557] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:35 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1280 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:35.256496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:35.265111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0d4625ba-916a-4bf5-9519-e2d6312caaae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1736 microversion: 2.1 time: 0.168147 Jun 15 10:35:35.265662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 267/558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:35 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:36.240264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:36.241518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:36.248968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.249416 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.250177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.250612 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.283174 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:36.283779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:36.290881 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.291491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.292340 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.292763 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.323503 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:36.331880 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:36.333422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:36.334573 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a838399e-5464-4fed-8904-5fe951139cee tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1276 microversion: 2.20 time: 0.098146 Jun 15 10:35:36.335171 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 292/559] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:36 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:35:36.433841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:36.441795 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c28205d3-b4f7-422d-95d9-cbc0c95364a2 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1716 microversion: 2.1 time: 0.162468 Jun 15 10:35:36.442353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 268/560] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:36 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:36.541714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:36.542201 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:36.548174 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.548611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.549572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.550006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.627498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] HTTP exception thrown: Cannot 'detach_volume' instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 while it is in vm_state rescued Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Request method failure captured: Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments/8de59cf2-0d0d-40ca-8768-a8bfedd0783d HTTP/1.1 Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbT6et4JMqBoWsOdn2Ym9JMKVSX3J81aX_m3gE1UmgYyhNRP-vipwrlrG_5xzsjm6FRel99SIUiGZnTUzewNJHlDm402FnGOBUeoBhuZVaIDt1uXxqXOAD7Yw0JcF1RvoalDzw2pFiC_EMmXWvomPs0TfmHo1HwGmpJwGYPKBn_yQfg Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:35:36.629078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 6d152f74395c4b6cb889058f612d502f Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:35:36.630391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Cannot 'detach_volume' instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 while it is in vm_state rescued Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'server_id': '2dc2e258-7d46-483d-b6d9-8c11d75d9b09', 'id': '8de59cf2-0d0d-40ca-8768-a8bfedd0783d'} Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:35:36.631034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 while it is in vm_state rescued Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 while it is in vm_state rescued Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:35:36.632622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Returning 409 to user: Cannot 'detach_volume' instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 while it is in vm_state rescued {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:35:36.633771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-613e0fa4-c463-46bb-a8e1-feeb4c7f65b8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments/8de59cf2-0d0d-40ca-8768-a8bfedd0783d" status: 409 len: 152 microversion: 2.1 time: 0.092779 Jun 15 10:35:36.633771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 293/561] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:35:36 2022] DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments/8de59cf2-0d0d-40ca-8768-a8bfedd0783d => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:35:36.639664 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:36.640189 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:36.646115 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.646561 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.647337 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.647768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.713802 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b09ea2a2-0a06-4752-9567-c0fa81ed6eb6 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "POST /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/action" status: 202 len: 0 microversion: 2.1 time: 0.078250 Jun 15 10:35:36.714450 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 269/562] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:35:36 2022] POST /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:35:36.723174 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:36.723993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:36.730258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.730713 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.731653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:36.732119 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:36.869435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:36.879353 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6050d7d5-ae39-4b37-9f67-7a544c05ff68 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1724 microversion: 2.1 time: 0.159941 Jun 15 10:35:36.880267 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 294/563] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:36 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:37.329812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-19d0275f-9221-4ada-b8a2-7e63ba01c1d1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:37.336219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-19d0275f-9221-4ada-b8a2-7e63ba01c1d1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.336667 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-19d0275f-9221-4ada-b8a2-7e63ba01c1d1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:37.352848 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:37.354008 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:37.359885 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-19d0275f-9221-4ada-b8a2-7e63ba01c1d1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Going to try to stop instance {{(pid=118865) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 10:35:37.360986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.361431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:37.362190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.362619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:37.404609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-19d0275f-9221-4ada-b8a2-7e63ba01c1d1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action" status: 202 len: 0 microversion: 2.1 time: 0.079348 Jun 15 10:35:37.405210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 270/564] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:35:37 2022] POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:35:37.415969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:37.417348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:37.424793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.425366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:37.426122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.426569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:37.437913 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:37.446558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:37.448069 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:37.449424 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8e714eb8-3ed5-4884-a9d3-a4082ef6f661 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1338 microversion: 2.20 time: 0.100426 Jun 15 10:35:37.460999 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 295/565] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:37 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:35:37.717185 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:37.724792 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ccc86d85-e0db-426d-9b35-db53b4955047 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.313435 Jun 15 10:35:37.725359 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 271/566] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:37 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:37.898399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:37.899470 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:37.906612 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.907074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:37.907856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:37.908284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:38.040883 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:38.049629 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0c29330f-9d67-43da-a62f-9290416ad267 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1724 microversion: 2.1 time: 0.155679 Jun 15 10:35:38.050509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 296/567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:37 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:38.468100 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:38.468611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:38.474969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:38.475555 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:38.476302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:38.476728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:38.600859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:38.609347 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:38.610827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:38.611934 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ff5d6f11-d4a7-47fb-9c25-1121fbf8a264 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.148394 Jun 15 10:35:38.612474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 272/568] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:38 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:38.742564 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:38.743123 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:38.749608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:38.750081 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:38.750829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:38.751297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:38.879250 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:38.886622 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e84eefda-bda3-4743-91d8-57532bae2327 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.148020 Jun 15 10:35:38.887724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 297/569] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:38 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:39.065821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:39.066426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:39.072448 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:39.072896 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:39.073651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:39.074081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:39.201204 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:39.209317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-16ec0e84-9877-4fdb-b785-8d101a94b629 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1724 microversion: 2.1 time: 0.147245 Jun 15 10:35:39.209871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 273/570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:39 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:39.629632 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:39.630380 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:39.636429 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:39.636875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:39.637637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:39.638071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:39.767631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:39.777325 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:39.779589 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:39.780710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d94a0301-a115-4533-a428-e1f45e100c5c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.154988 Jun 15 10:35:39.781485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 298/571] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:39 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:39.904761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:39.905365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:39.911825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:39.912266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:39.913018 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:39.913452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.113849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:40.122953 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4b7c99c9-dc98-4d3f-bc03-fe9d9e2711c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.222697 Jun 15 10:35:40.123701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 274/572] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:39 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:40.223309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-43d3eed1-f2be-4fc5-9cb9-ecb118aaf400 req-367ebfb1-90e6-4d6f-8bd5-cd5215a47b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:40.226014 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:40.226856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:40.232518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-43d3eed1-f2be-4fc5-9cb9-ecb118aaf400 req-367ebfb1-90e6-4d6f-8bd5-cd5215a47b44 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.232947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-43d3eed1-f2be-4fc5-9cb9-ecb118aaf400 req-367ebfb1-90e6-4d6f-8bd5-cd5215a47b44 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.234971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.235699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.236549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.237062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.250238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-43d3eed1-f2be-4fc5-9cb9-ecb118aaf400 req-367ebfb1-90e6-4d6f-8bd5-cd5215a47b44 service nova] Creating event network-changed:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:35:40.256679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-43d3eed1-f2be-4fc5-9cb9-ecb118aaf400 req-367ebfb1-90e6-4d6f-8bd5-cd5215a47b44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039775 Jun 15 10:35:40.257553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 299/573] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:40.373846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:40.382351 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3d42b768-1712-42d7-b53e-5f3aa23b92ee tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1730 microversion: 2.1 time: 0.160443 Jun 15 10:35:40.382907 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 275/574] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:40 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:40.399321 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:40.399907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:40.407355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.407801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.408561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.408992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.490041 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aca231ba-7331-4e36-9074-f8c372171e90 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095126 Jun 15 10:35:40.490631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 300/575] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:35:40 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:40.798546 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:40.799192 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:40.805518 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.805878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:40.806650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:40.807120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:41.029640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:41.037836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:41.039468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:41.040644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5f088b1d-b3e5-44b5-820d-c348e95bd1e7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.245973 Jun 15 10:35:41.041284 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 276/576] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:40 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:41.141865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:41.143820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:41.151570 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:41.152084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:41.153536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:41.154190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:41.376221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:41.384684 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-923c7b3d-b94c-4370-b006-0e1102041488 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.248327 Jun 15 10:35:41.385532 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 301/577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:41 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:41.629923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-25d63897-8d31-4503-af7a-f36a5b2ee1a7 req-0368bc9f-0d1f-4cc2-8fbf-9b1c11937131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dc2e258-7d46-483d-b6d9-8c11d75d9b09", "tag": "b55b6c61-87be-499d-9c71-6698d6514e2d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:41.639363 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-25d63897-8d31-4503-af7a-f36a5b2ee1a7 req-0368bc9f-0d1f-4cc2-8fbf-9b1c11937131 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:41.640023 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-25d63897-8d31-4503-af7a-f36a5b2ee1a7 req-0368bc9f-0d1f-4cc2-8fbf-9b1c11937131 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:41.654093 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-25d63897-8d31-4503-af7a-f36a5b2ee1a7 req-0368bc9f-0d1f-4cc2-8fbf-9b1c11937131 service nova] Creating event network-changed:b55b6c61-87be-499d-9c71-6698d6514e2d for instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 on hv-cinder-84349 Jun 15 10:35:41.660324 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-25d63897-8d31-4503-af7a-f36a5b2ee1a7 req-0368bc9f-0d1f-4cc2-8fbf-9b1c11937131 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033991 Jun 15 10:35:41.661446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 277/578] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:42.057772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:42.058409 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:42.064384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:42.064827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:42.065578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:42.066003 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:42.195264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:42.203256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:42.204754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:42.205843 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-79b068a7-fe37-4fab-958d-7f74552e079f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.152028 Jun 15 10:35:42.206390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 302/579] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:42 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:42.406900 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:42.407625 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:42.414629 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:42.415115 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:42.415880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:42.416320 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:42.546581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:42.554083 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-808c24c1-d82a-4070-9fc6-6f0dc49db613 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.152077 Jun 15 10:35:42.554642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 278/580] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:42 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:43.223968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:43.224586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:43.231825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:43.232265 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:43.233017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:43.233443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:43.359257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:43.367137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:43.368568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:43.369649 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9e975a45-b2ee-4b00-a7b1-287523fa4441 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.149638 Jun 15 10:35:43.370193 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 303/581] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:43 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:43.570861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:43.571498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:43.578046 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:43.578495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:43.579287 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:43.579724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:43.675456 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-d3e5546c-1287-4d5e-bdcb-6686f033a6b0 req-045b61f2-a8d2-4d43-8876-e67b0d700c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dc2e258-7d46-483d-b6d9-8c11d75d9b09", "tag": "b55b6c61-87be-499d-9c71-6698d6514e2d"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:43.683351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-d3e5546c-1287-4d5e-bdcb-6686f033a6b0 req-045b61f2-a8d2-4d43-8876-e67b0d700c55 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:43.683788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-d3e5546c-1287-4d5e-bdcb-6686f033a6b0 req-045b61f2-a8d2-4d43-8876-e67b0d700c55 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:43.694412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-d3e5546c-1287-4d5e-bdcb-6686f033a6b0 req-045b61f2-a8d2-4d43-8876-e67b0d700c55 service nova] Creating event network-changed:b55b6c61-87be-499d-9c71-6698d6514e2d for instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 on hv-cinder-84349 Jun 15 10:35:43.699557 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-d3e5546c-1287-4d5e-bdcb-6686f033a6b0 req-045b61f2-a8d2-4d43-8876-e67b0d700c55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027605 Jun 15 10:35:43.700182 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 304/582] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:35:43.705716 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:43.713245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5b3d47ba-1a77-454f-9b2e-85435ba91a8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.146189 Jun 15 10:35:43.713798 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 279/583] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:43 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:44.389516 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:44.390216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:44.396566 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:44.397021 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:44.397786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:44.398225 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:44.526189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:44.534363 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:44.535886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:44.536976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-658e45b1-cc0e-4090-8b7c-e45324215d97 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.152832 Jun 15 10:35:44.537534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 305/584] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:44 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:44.732001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:44.732614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:44.739293 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:44.739730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:44.740509 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:44.740926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:44.744998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:44.878346 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:44.885727 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bea59af4-7416-4d35-9352-2a003bc51fdb tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.158238 Jun 15 10:35:44.886281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 280/585] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:44 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:45.553770 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:45.554376 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:45.556406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:45.562348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:45.562794 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:45.563578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:45.564016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:45.689841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:45.697702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:45.699720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:45.700818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b7139019-1357-4b0e-a54f-6065e2d667a7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.150988 Jun 15 10:35:45.701369 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 306/586] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:45 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:45.902254 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:45.903194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:45.905025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:45.905677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=10 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:45.912298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:45.912742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:45.913492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:45.913923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:46.038482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:46.046015 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-12329c23-0ddb-4778-a71d-f11c09bda95f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.147576 Jun 15 10:35:46.046565 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 281/587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:45 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:46.665355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-625268af-6f4d-4ccc-bf11-1e2a464a5bf6 req-d28ab5c1-13a4-470a-8e13-deb68e176982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "name": "network-vif-plugged", "status": "completed", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:46.674887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-625268af-6f4d-4ccc-bf11-1e2a464a5bf6 req-d28ab5c1-13a4-470a-8e13-deb68e176982 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:46.675387 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-625268af-6f4d-4ccc-bf11-1e2a464a5bf6 req-d28ab5c1-13a4-470a-8e13-deb68e176982 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:46.687226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-625268af-6f4d-4ccc-bf11-1e2a464a5bf6 req-d28ab5c1-13a4-470a-8e13-deb68e176982 service nova] Creating event network-vif-plugged:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:35:46.691927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-625268af-6f4d-4ccc-bf11-1e2a464a5bf6 req-d28ab5c1-13a4-470a-8e13-deb68e176982 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Jun 15 10:35:46.692864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 307/588] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:46.718098 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:46.718701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:46.724707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:46.725155 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:46.725919 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:46.726349 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:46.863420 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:46.871466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:46.873450 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:46.874551 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1428bf09-694b-45f9-81ba-48439931e339 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.160391 Jun 15 10:35:46.875217 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 282/589] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:46 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:47.063831 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:47.064529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:47.070666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:47.071145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:47.071907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:47.072339 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:47.198149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:47.206075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-daef27c0-aaf0-47d0-877e-e21c24305af4 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1678 microversion: 2.1 time: 0.147148 Jun 15 10:35:47.206624 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 308/590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:47 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:35:47.892261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:47.892861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:47.899472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:47.899930 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:47.900691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:47.901129 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:48.031889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:48.040856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:48.042674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:48.043868 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-01d5b40f-a852-44e9-8328-5eb7c101b5ea tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1405 microversion: 2.20 time: 0.155501 Jun 15 10:35:48.045186 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 283/591] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:47 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:48.222873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:48.223525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:48.230075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:48.230535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:48.231352 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:48.232368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:48.365302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:48.367617 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:48.374595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e78ad01c-5638-4630-b36e-ffdbed2803a3 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1655 microversion: 2.1 time: 0.155599 Jun 15 10:35:48.375216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 309/592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:48 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:48.391117 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-dd84ab1e-4e3d-4f78-a63a-a7d975924e51 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:48.397486 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dd84ab1e-4e3d-4f78-a63a-a7d975924e51 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:48.397929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-dd84ab1e-4e3d-4f78-a63a-a7d975924e51 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:48.420050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-dd84ab1e-4e3d-4f78-a63a-a7d975924e51 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Going to try to start instance {{(pid=118865) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 10:35:48.460817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-dd84ab1e-4e3d-4f78-a63a-a7d975924e51 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action" status: 202 len: 0 microversion: 2.1 time: 0.073894 Jun 15 10:35:48.461397 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 284/593] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:35:48 2022] POST /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:35:48.470357 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:48.470964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:48.477149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:48.477604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:48.478365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:48.478804 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:48.604467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:48.611979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bcbafb68-8f66-4d53-9852-91c1d94a2a5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1664 microversion: 2.1 time: 0.146451 Jun 15 10:35:48.612530 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 310/594] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:48 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1664 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:49.062863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:49.063803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:49.070536 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:49.070977 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:49.071796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:49.072226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:49.278520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:49.286452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:49.287971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:49.289104 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e2d8c69a-cddc-42b8-8109-1c8ccab100a0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1597 microversion: 2.20 time: 0.231070 Jun 15 10:35:49.289650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 285/595] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:35:49 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1597 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:35:49.306749 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:49.307401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:49.310329 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:49.316440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:49.316928 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:49.317702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:49.318140 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:49.393406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-57da41e9-d797-4549-b841-97243c237f29 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090466 Jun 15 10:35:49.394038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 311/596] 10.222.0.49 () {60 vars in 1315 bytes} [Wed Jun 15 10:35:49 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:35:49.629733 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:49.630335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:49.636323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:49.636756 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:49.637509 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:49.637944 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:49.907012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:49.914415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cc4fcdb8-9b1d-4d8b-9bf4-11ee8d05749e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1664 microversion: 2.1 time: 0.288541 Jun 15 10:35:49.914970 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 286/597] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:49 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1664 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:50.428053 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-0c9999ae-d989-454c-9ecb-e161ab08a673 req-af68bdea-910f-4e06-846f-e467b2db660a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:50.436637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-0c9999ae-d989-454c-9ecb-e161ab08a673 req-af68bdea-910f-4e06-846f-e467b2db660a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:50.437071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-0c9999ae-d989-454c-9ecb-e161ab08a673 req-af68bdea-910f-4e06-846f-e467b2db660a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:50.448704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-0c9999ae-d989-454c-9ecb-e161ab08a673 req-af68bdea-910f-4e06-846f-e467b2db660a service nova] Creating event network-changed:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:35:50.455149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-0c9999ae-d989-454c-9ecb-e161ab08a673 req-af68bdea-910f-4e06-846f-e467b2db660a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031360 Jun 15 10:35:50.455834 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 312/598] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:50.931808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:50.932533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:50.940242 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:50.940683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:50.941525 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:50.941977 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:51.401315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:35:51.410631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-30358e4b-b0f9-406d-b609-411acc65c8c7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1668 microversion: 2.1 time: 0.482840 Jun 15 10:35:51.411256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 287/599] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:35:50 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1668 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:35:55.438365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:35:55.438919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:55.445705 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:55.446141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:55.446984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:55.447439 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:55.470753 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9a8d3e42-605f-4298-a852-e688045e520b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/ips" status: 200 len: 150 microversion: 2.1 time: 0.036536 Jun 15 10:35:55.471418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 313/600] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:35:55 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:35:56.787552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d69f303a-05da-4981-a380-cc3024a0ee9d"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:35:56.788683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:35:56.791331 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:56.797234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:56.797698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:56.798443 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:35:56.798877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:35:57.072839 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ad369538-cfe6-4b81-adc6-b767233fe157 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289006 Jun 15 10:35:57.073438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 288/601] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:35:56 2022] POST /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:04.328457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1954660974"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:04.329053 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:04.335706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.336157 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.336910 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.337342 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.465781 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.network.security_group_api [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Removing security group 62a3b29d-809d-4c70-b47f-061dc9e5714f from port 700c7452-e992-4ca6-b384-90723c15324d Jun 15 10:36:04.547296 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d69f303a-05da-4981-a380-cc3024a0ee9d"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:04.548970 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:04.555197 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.555644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.556402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.556833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.637152 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Invalid volume: volume d69f303a-05da-4981-a380-cc3024a0ee9d is already attached to instances: c41bb315-40ff-4372-90e4-b8f405548765 Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: POST /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments HTTP/1.1 Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 74 Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:36:04.639061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {"volumeAttachment": {"volumeId": "d69f303a-05da-4981-a380-cc3024a0ee9d"}} Jun 15 10:36:04.640698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Invalid volume: volume d69f303a-05da-4981-a380-cc3024a0ee9d is already attached to instances: c41bb315-40ff-4372-90e4-b8f405548765 Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'server_id': 'c41bb315-40ff-4372-90e4-b8f405548765', 'body': {'volumeAttachment': {'volumeId': 'd69f303a-05da-4981-a380-cc3024a0ee9d'}}} Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d69f303a-05da-4981-a380-cc3024a0ee9d is already attached to instances: c41bb315-40ff-4372-90e4-b8f405548765 Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:04.641481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d69f303a-05da-4981-a380-cc3024a0ee9d is already attached to instances: c41bb315-40ff-4372-90e4-b8f405548765 Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:04.642686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d69f303a-05da-4981-a380-cc3024a0ee9d is already attached to instances: c41bb315-40ff-4372-90e4-b8f405548765 Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 400 to user: Invalid volume: volume d69f303a-05da-4981-a380-cc3024a0ee9d is already attached to instances: c41bb315-40ff-4372-90e4-b8f405548765 {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d98aeba0-79df-4a36-84c5-6289ce553340 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099146 Jun 15 10:36:04.643908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 289/602] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:36:04 2022] POST /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:36:04.702157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:04.702641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:04.709842 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.710283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.711028 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.711483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.798084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lazy-loading 'services' on Instance uuid c41bb315-40ff-4372-90e4-b8f405548765 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:04.849818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1d94dbc0-80c7-4a01-9b54-befe4b325b03 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/action" status: 202 len: 0 microversion: 2.1 time: 0.525208 Jun 15 10:36:04.856422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 314/603] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:36:04 2022] POST /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:36:04.887483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7e5504e4-834c-4716-aad4-6307a33a02b0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments/d69f303a-05da-4981-a380-cc3024a0ee9d" status: 202 len: 0 microversion: 2.1 time: 0.188792 Jun 15 10:36:04.891337 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 290/604] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:36:04 2022] DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments/d69f303a-05da-4981-a380-cc3024a0ee9d => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:36:04.898301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:04.899402 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:04.907445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.907983 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.908824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.909686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.913768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-caa06011-4b75-4a6a-8b57-837934ac99ab req-8ac7a242-a095-4c56-b190-c24553364241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:04.941691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-caa06011-4b75-4a6a-8b57-837934ac99ab req-8ac7a242-a095-4c56-b190-c24553364241 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:04.942134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-caa06011-4b75-4a6a-8b57-837934ac99ab req-8ac7a242-a095-4c56-b190-c24553364241 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:04.948170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4a65bf17-e516-4a65-8442-deff7a784b3b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053850 Jun 15 10:36:04.949309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 315/605] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:04 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:04.961228 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-caa06011-4b75-4a6a-8b57-837934ac99ab req-8ac7a242-a095-4c56-b190-c24553364241 service nova] Creating event network-changed:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:36:04.976137 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-caa06011-4b75-4a6a-8b57-837934ac99ab req-8ac7a242-a095-4c56-b190-c24553364241 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068700 Jun 15 10:36:04.980806 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 291/606] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:05.962523 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:05.963740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:05.977692 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:05.978791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:05.980009 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:05.980460 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:05.980582 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:05.982768 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:05.988043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:05.988485 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:05.989971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:05.990404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:06.022747 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aeb5b170-7ccb-442b-8872-68195bb6092d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066421 Jun 15 10:36:06.023946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 316/607] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:05 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:06.091875 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lazy-loading 'services' on Instance uuid 66917c2a-3a37-464a-b12c-68f7e8a2089d {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:06.163190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-57282e11-2c76-440f-8fa9-84edeedb108b tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments/271c3174-ac6d-4b7f-baab-17d268dda02e" status: 202 len: 0 microversion: 2.1 time: 0.187155 Jun 15 10:36:06.163812 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 292/608] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:36:05 2022] DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments/271c3174-ac6d-4b7f-baab-17d268dda02e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:36:06.172800 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:06.173719 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:06.179646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:06.180275 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:06.181040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:06.181474 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:06.211394 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fa3e4c44-e25e-4580-8163-8fad5b2986f9 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jun 15 10:36:06.211936 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 317/609] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:06 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:06.991984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-60ad03ed-54cf-4e13-b07a-41874cd06e54 req-3cb97f28-726b-49a7-a7a7-1ce15db83e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:07.000076 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-60ad03ed-54cf-4e13-b07a-41874cd06e54 req-3cb97f28-726b-49a7-a7a7-1ce15db83e9b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.001019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-60ad03ed-54cf-4e13-b07a-41874cd06e54 req-3cb97f28-726b-49a7-a7a7-1ce15db83e9b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.011430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-60ad03ed-54cf-4e13-b07a-41874cd06e54 req-3cb97f28-726b-49a7-a7a7-1ce15db83e9b service nova] Creating event network-changed:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:36:07.016730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-60ad03ed-54cf-4e13-b07a-41874cd06e54 req-3cb97f28-726b-49a7-a7a7-1ce15db83e9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028689 Jun 15 10:36:07.017278 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 293/610] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:07.035710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:07.036641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:07.043005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.043493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.044241 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.044667 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.076017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-20b0f2e0-6d94-44a2-ab42-5a9b5fa55099 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044422 Jun 15 10:36:07.076561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 318/611] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:07 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:36:07.132986 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:07.133562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:07.139726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.140170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.141423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.141855 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.160679 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:07.169202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:36:07.226229 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:07.227459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:07.235397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.235979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.236861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.237454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.270908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7bc7f847-ff10-4d55-aba9-de72266c536a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 204 len: 0 microversion: 2.1 time: 0.141572 Jun 15 10:36:07.271799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 294/612] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:36:07 2022] DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:36:07.273628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3eb2a423-79cb-4848-a448-6794851d3056 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053229 Jun 15 10:36:07.274333 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 319/613] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:07 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:36:07.286586 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:07.287365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:07.293321 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.293766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.294523 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:07.294953 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:07.422114 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:07.429592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e915f902-0382-4857-89cf-c06e9399059c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1681 microversion: 2.1 time: 0.153589 Jun 15 10:36:07.430146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 295/614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:07 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:08.285490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:08.286417 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:08.293024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:08.293477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:08.294240 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:08.294675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:08.323256 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b1d5315a-b69e-44c0-9f28-9d45e74f9d68 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042045 Jun 15 10:36:08.323796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 320/615] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:08 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:36:08.333357 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:08.333845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:08.340317 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:08.340760 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:08.341505 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:08.341934 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:08.414042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] HTTP exception thrown: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d is not attached to volume 271c3174-ac6d-4b7f-baab-17d268dda02e Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Request method failure captured: Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments/271c3174-ac6d-4b7f-baab-17d268dda02e HTTP/1.1 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbVvD7IAOiQ8gXuTAsJ2UgROfGVZeVGEyGBS7LUotCB6bH_e7zwINJdlbx-xuF1GIy6ew0VhQWvFa1M_nMt35wTwy5rx7QFs9KhYr0PIEvNjOLssNqmnE5v4YogHtNQaMX3VY99xTW0AUMMRrQ6Yv67cz8AvK4-3kEN0I0L6s1uHEa8 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 440f69d2725e435ab11b2fc658e1e745 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-TestMinimumBasicScenario-300672064 Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:36:08.416474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-TestMinimumBasicScenario-300672064 Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 440f69d2725e435ab11b2fc658e1e745 Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-TestMinimumBasicScenario-300672064 Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-TestMinimumBasicScenario-300672064-project Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 572ac94e242f414aab152286fa356335 Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-TestMinimumBasicScenario-300672064-project Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:36:08.418043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d is not attached to volume 271c3174-ac6d-4b7f-baab-17d268dda02e Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'server_id': '66917c2a-3a37-464a-b12c-68f7e8a2089d', 'id': '271c3174-ac6d-4b7f-baab-17d268dda02e'} Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 271c3174-ac6d-4b7f-baab-17d268dda02e. Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:08.418901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d is not attached to volume 271c3174-ac6d-4b7f-baab-17d268dda02e Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d is not attached to volume 271c3174-ac6d-4b7f-baab-17d268dda02e Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:08.420333 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Returning 404 to user: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d is not attached to volume 271c3174-ac6d-4b7f-baab-17d268dda02e {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:08.421492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-74d80915-87b8-43c7-aa0d-60dbe25715ca tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments/271c3174-ac6d-4b7f-baab-17d268dda02e" status: 404 len: 154 microversion: 2.1 time: 0.088503 Jun 15 10:36:08.421492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 296/616] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:36:08 2022] DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d/os-volume_attachments/271c3174-ac6d-4b7f-baab-17d268dda02e => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:36:08.448483 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:08.449180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:08.455443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:08.456192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:08.457361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:08.457870 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:08.591229 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:08.599301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a15cdcf5-c9de-4fa1-93de-5e0f8f38cea1 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1681 microversion: 2.1 time: 0.154558 Jun 15 10:36:08.599867 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 321/617] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:08 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:09.552938 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:09.553456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:09.560154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:09.560606 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:09.561438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:09.561879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:09.587144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:36:09.616603 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:09.617440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:09.624435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:09.624824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:09.626422 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:09.627012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:09.668413 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c512530d-1f0c-4a91-b640-8c7438e54fb1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 204 len: 0 microversion: 2.1 time: 0.118942 Jun 15 10:36:09.669001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 297/618] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:36:09 2022] DELETE /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:36:09.678595 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:09.679404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:09.685455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:09.685909 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:09.686731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:09.687448 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:09.764744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:09.774117 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a95ace71-7441-4df6-98c9-ed2b1d8fc7c7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1681 microversion: 2.1 time: 0.161320 Jun 15 10:36:09.775238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 322/619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:09 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:09.886288 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:09.893813 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a1bece46-c070-4ef6-bf90-045fd635c3ef tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1554 microversion: 2.1 time: 0.219346 Jun 15 10:36:09.894381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 298/620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:09 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:10.195166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-464154fa-24ea-43c2-a04f-6a13a147b519 req-08c0b2b4-e860-4073-96c6-a4cdda81b717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41bb315-40ff-4372-90e4-b8f405548765", "name": "network-vif-deleted", "tag": "3566e96c-46a9-4c41-af85-9632202f0396"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:10.203828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-464154fa-24ea-43c2-a04f-6a13a147b519 req-08c0b2b4-e860-4073-96c6-a4cdda81b717 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:10.204228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-464154fa-24ea-43c2-a04f-6a13a147b519 req-08c0b2b4-e860-4073-96c6-a4cdda81b717 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:10.214899 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-464154fa-24ea-43c2-a04f-6a13a147b519 req-08c0b2b4-e860-4073-96c6-a4cdda81b717 service nova] Creating event network-vif-deleted:3566e96c-46a9-4c41-af85-9632202f0396 for instance c41bb315-40ff-4372-90e4-b8f405548765 on hv-cinder-84349 Jun 15 10:36:10.220529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-464154fa-24ea-43c2-a04f-6a13a147b519 req-08c0b2b4-e860-4073-96c6-a4cdda81b717 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029238 Jun 15 10:36:10.221110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 323/621] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:10.792332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:10.792954 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:10.801252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:10.801707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:10.802488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:10.802929 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:10.867743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:10.881648 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bccfc22b-ffb6-45f8-9c49-f4befcbb6653 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1615 microversion: 2.1 time: 0.092997 Jun 15 10:36:10.882236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 299/622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:10 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1615 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:10.911575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:10.912276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:10.919062 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:10.919542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:10.920305 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:10.920732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:11.050400 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:11.058163 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-22c39997-c169-4da0-982b-cbc6517aee39 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1554 microversion: 2.1 time: 0.150717 Jun 15 10:36:11.058740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 324/623] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:10 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:11.897609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:11.898245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:11.905107 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:11.905556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:11.906361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:11.906828 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:11.940877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:11.941322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:11.941770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lazy-loading 'fault' on Instance uuid c41bb315-40ff-4372-90e4-b8f405548765 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:11.981506 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:11.989061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d79a4767-5161-48b9-93f3-a9349eaaaa84 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 200 len: 1332 microversion: 2.1 time: 0.095284 Jun 15 10:36:11.989619 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 300/624] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:11 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:12.074793 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:12.075355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:12.082566 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:12.083016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:12.083814 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:12.084252 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:12.216728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:12.225077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fd46f51d-5d1e-4cba-827f-3c1685c36ca6 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1554 microversion: 2.1 time: 0.154189 Jun 15 10:36:12.226524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 325/625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:12 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:12.647734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-c14a64d8-2347-45e0-8be5-98e6f39eea10 req-74141668-c759-49d1-bee2-d2f70fadb28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66917c2a-3a37-464a-b12c-68f7e8a2089d", "name": "network-vif-deleted", "tag": "700c7452-e992-4ca6-b384-90723c15324d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:12.658045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-c14a64d8-2347-45e0-8be5-98e6f39eea10 req-74141668-c759-49d1-bee2-d2f70fadb28a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:12.658489 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-c14a64d8-2347-45e0-8be5-98e6f39eea10 req-74141668-c759-49d1-bee2-d2f70fadb28a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:12.670285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-c14a64d8-2347-45e0-8be5-98e6f39eea10 req-74141668-c759-49d1-bee2-d2f70fadb28a service nova] Creating event network-vif-deleted:700c7452-e992-4ca6-b384-90723c15324d for instance 66917c2a-3a37-464a-b12c-68f7e8a2089d on hv-cinder-84349 Jun 15 10:36:12.675765 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-c14a64d8-2347-45e0-8be5-98e6f39eea10 req-74141668-c759-49d1-bee2-d2f70fadb28a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Jun 15 10:36:12.676661 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 301/626] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:13.005872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:13.006585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:13.016515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:13.018488 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:13.019410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:13.020057 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:13.035522 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 HTTP/1.1 Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:36:13.037168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:36:13.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'c41bb315-40ff-4372-90e4-b8f405548765'} Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:13.039569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:36:13.040976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:13.042258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:13.042258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ded4fa8a-c6cd-4f57-bc1a-7e75aeab0731 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 404 len: 111 microversion: 2.1 time: 0.036567 Jun 15 10:36:13.042258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 326/627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:13 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:36:13.048101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2bd85bfa-93ce-43aa-bb17-18d2fc11e617 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '.version_select at 0x7feb3aab1d30>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:13.065788 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2bd85bfa-93ce-43aa-bb17-18d2fc11e617 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855293030" status: 202 len: 0 microversion: 2.1 time: 0.021622 Jun 15 10:36:13.066375 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 302/628] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jun 15 10:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1855293030 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:36:13.242383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:13.244553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:13.250099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:13.250545 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:13.251343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:13.251784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:13.288774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:13.289222 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:13.289668 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lazy-loading 'fault' on Instance uuid 66917c2a-3a37-464a-b12c-68f7e8a2089d {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:13.367175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572ac94e242f414aab152286fa356335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '440f69d2725e435ab11b2fc658e1e745', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:13.374135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bfcc7b9e-2f4c-43c6-9621-7fa12f6a4032 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 200 len: 1348 microversion: 2.1 time: 0.135654 Jun 15 10:36:13.374887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 327/629] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:13 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 1348 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:13.904141 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-477527c7-3405-4f94-9990-453ede18ec13 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: .version_select at 0x7feb3ae33ca0>, body: {"keypair": {"name": "tempest-keypair-501060140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK7ZBeNovemOyapt4kX6mUsEndCxjQi5FwWlMomM46qxWuo/MoNmMNHSG/RTX/PaKFC4iMkYmoPNJ4HcrIEGj8ude/f+Ppuc8ANvvMbxeKfsuYhOziQyRFFNOSGE015WQ=="}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:13.918124 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-477527c7-3405-4f94-9990-453ede18ec13 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:36:13.921818 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-477527c7-3405-4f94-9990-453ede18ec13 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:36:13.943308 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-477527c7-3405-4f94-9990-453ede18ec13 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043246 Jun 15 10:36:13.943865 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 303/630] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:36:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:14.390900 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:14.391534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] [instance: 66917c2a-3a37-464a-b12c-68f7e8a2089d] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:14.398141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:14.398584 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:14.399366 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:14.399803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:14.413755 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] HTTP exception thrown: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d could not be found. Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Request method failure captured: Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d HTTP/1.1 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbVvD7IAOiQ8gXuTAsJ2UgROfGVZeVGEyGBS7LUotCB6bH_e7zwINJdlbx-xuF1GIy6ew0VhQWvFa1M_nMt35wTwy5rx7QFs9KhYr0PIEvNjOLssNqmnE5v4YogHtNQaMX3VY99xTW0AUMMRrQ6Yv67cz8AvK4-3kEN0I0L6s1uHEa8 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 440f69d2725e435ab11b2fc658e1e745 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-TestMinimumBasicScenario-300672064 Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:36:14.415332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/440f69d2725e435ab11b2fc658e1e745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-TestMinimumBasicScenario-300672064 Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 440f69d2725e435ab11b2fc658e1e745 Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-300672064 Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-TestMinimumBasicScenario-300672064-project Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 572ac94e242f414aab152286fa356335 Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-TestMinimumBasicScenario-300672064-project Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d could not be found. Jun 15 10:36:14.417040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '66917c2a-3a37-464a-b12c-68f7e8a2089d'} Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d could not be found. Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:14.417869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d could not be found. Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d could not be found. Jun 15 10:36:14.419332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:14.421334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Returning 404 to user: Instance 66917c2a-3a37-464a-b12c-68f7e8a2089d could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:14.421334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8e9136a4-5194-4d07-b5d7-e86f922cce50 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d" status: 404 len: 111 microversion: 2.1 time: 0.029766 Jun 15 10:36:14.421334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 328/631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:14 2022] GET /compute/v2.1/servers/66917c2a-3a37-464a-b12c-68f7e8a2089d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:36:14.426363 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c7f2530a-cb3f-4b44-85e2-edecc6c114a1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] Calling method '.version_select at 0x7feb3aaac8b0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:14.442876 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c7f2530a-cb3f-4b44-85e2-edecc6c114a1 tempest-TestMinimumBasicScenario-300672064 tempest-TestMinimumBasicScenario-300672064-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1992786128" status: 202 len: 0 microversion: 2.1 time: 0.021206 Jun 15 10:36:14.443482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 304/632] 10.222.0.49 () {58 vars in 1271 bytes} [Wed Jun 15 10:36:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1992786128 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:36:15.164954 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1102286608", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56f473a9-939b-4bd2-a5d0-e5eaaaa25745"}], "security_groups": [{"name": "tempest-securitygroup--789001589"}], "key_name": "tempest-keypair-501060140", "user_data": "}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:15.371033 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] validate_networks() for [('56f473a9-939b-4bd2-a5d0-e5eaaaa25745', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:36:16.027904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:36:16.028468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:36:16.028784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:36:16.029224 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:36:16.029633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:36:16.039055 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:16.039531 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:16.040327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:16.040792 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:16.057519 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:36:16.061855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Getting quotas for user 14b720a2d0854d218272390205887100 and project b683b2d399b54484aa5820537038b8af. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:36:16.072851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:36:16.075113 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:36:16.122672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-28abe111-5906-415e-a516-1cd7a0095b18 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.962033 Jun 15 10:36:16.123857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 329/633] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:36:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:36:16.134314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-92e1ed7b-5223-4f43-83a6-f294325320fe tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:16.135038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-92e1ed7b-5223-4f43-83a6-f294325320fe tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:16.390300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-92e1ed7b-5223-4f43-83a6-f294325320fe tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:16.401478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-92e1ed7b-5223-4f43-83a6-f294325320fe tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1241 microversion: 2.1 time: 0.271088 Jun 15 10:36:16.402803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 305/634] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:16 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1241 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:17.420496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:17.422482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:17.432080 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:17.432563 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:17.433916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:17.434525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:17.466208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:17.614663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:17.624776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f8e8421c-e1af-4abf-8972-e873494b3d8d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1311 microversion: 2.1 time: 0.209003 Jun 15 10:36:17.626013 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 330/635] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:17 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:18.642703 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:18.643520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:18.658528 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:18.659249 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:18.660226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:18.660983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:18.968816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:18.976274 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c86274ef-442e-4d2b-b79c-1922349d2fc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.338435 Jun 15 10:36:18.976833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 306/636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:18 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:19.578731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-127790dd-4dc1-4d8a-84d2-0e38a24c7d11 req-c16bcaf1-b370-417f-889c-47dc6ff2027b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0264e78-46e5-4622-92f7-b4ea5a4708fd", "tag": "224da4da-f789-4111-bbb8-87943e241db9"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:19.584572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:19.592471 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-127790dd-4dc1-4d8a-84d2-0e38a24c7d11 req-c16bcaf1-b370-417f-889c-47dc6ff2027b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:19.593060 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-127790dd-4dc1-4d8a-84d2-0e38a24c7d11 req-c16bcaf1-b370-417f-889c-47dc6ff2027b service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:19.614508 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-127790dd-4dc1-4d8a-84d2-0e38a24c7d11 req-c16bcaf1-b370-417f-889c-47dc6ff2027b service nova] Creating event network-changed:224da4da-f789-4111-bbb8-87943e241db9 for instance b0264e78-46e5-4622-92f7-b4ea5a4708fd on hv-cinder-84349 Jun 15 10:36:19.621217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-127790dd-4dc1-4d8a-84d2-0e38a24c7d11 req-c16bcaf1-b370-417f-889c-47dc6ff2027b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046757 Jun 15 10:36:19.622490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 331/637] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:36:19.993450 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:19.994052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:20.000690 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:20.001153 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:20.001903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:20.002330 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:20.298136 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:20.305793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8134067a-64d6-4bf0-b999-60fa16518500 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.316322 Jun 15 10:36:20.306371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 307/638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:19 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:21.324423 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:21.325924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:21.334619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:21.335234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:21.336114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:21.336652 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:21.476450 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:21.484560 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6e91b5b1-abbf-4914-ab7f-74d7a8adca81 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.165111 Jun 15 10:36:21.487129 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 332/639] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:21 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:22.502866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:22.504480 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:22.517852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:22.517852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:22.517852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:22.517852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:22.526994 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:22.527858 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:22.542787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:22.543292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:22.544261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:22.548981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:22.703662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'services' on Instance uuid 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:22.827665 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:22.850901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0705eddf-8e77-4446-bcd8-fdd970ea9fa0 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.353356 Jun 15 10:36:22.853304 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 308/640] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:22 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:22.855675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8f44fb3d-1361-4ffe-b74b-987468db6e3d tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments/8de59cf2-0d0d-40ca-8768-a8bfedd0783d" status: 202 len: 0 microversion: 2.1 time: 0.335907 Jun 15 10:36:22.860153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 333/641] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:36:22 2022] DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments/8de59cf2-0d0d-40ca-8768-a8bfedd0783d => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:36:22.864880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:22.865819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:22.891391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:22.892076 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:22.893012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:22.893612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:22.950238 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6fb98129-efb3-4320-a954-ea6a1c6a59fb tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088408 Jun 15 10:36:22.956483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 309/642] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:22 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:23.870782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:23.871590 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:23.879482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:23.880237 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:23.881103 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:23.881754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:23.966644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:23.968405 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:23.976496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:23.977148 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:23.977911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:23.978402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:24.014139 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5d8c6917-5874-4759-a868-788e90e44794 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054275 Jun 15 10:36:24.014800 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 310/643] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:23 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:36:24.026868 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:24.035588 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2f05eb1d-6894-46c6-8576-fc1ea4b963e6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.169829 Jun 15 10:36:24.036216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 334/644] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:23 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:24.984399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-db08dcdf-67cc-40bd-8b4b-f73899155772 req-45113f43-712f-496a-8eee-709459add1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0264e78-46e5-4622-92f7-b4ea5a4708fd", "name": "network-vif-plugged", "status": "completed", "tag": "224da4da-f789-4111-bbb8-87943e241db9"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:24.992987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-db08dcdf-67cc-40bd-8b4b-f73899155772 req-45113f43-712f-496a-8eee-709459add1b3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:24.993434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-db08dcdf-67cc-40bd-8b4b-f73899155772 req-45113f43-712f-496a-8eee-709459add1b3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.005322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-db08dcdf-67cc-40bd-8b4b-f73899155772 req-45113f43-712f-496a-8eee-709459add1b3 service nova] Creating event network-vif-plugged:224da4da-f789-4111-bbb8-87943e241db9 for instance b0264e78-46e5-4622-92f7-b4ea5a4708fd on hv-cinder-84349 Jun 15 10:36:25.010177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-db08dcdf-67cc-40bd-8b4b-f73899155772 req-45113f43-712f-496a-8eee-709459add1b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 Jun 15 10:36:25.010738 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 311/645] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:25.024968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:25.025899 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:25.032632 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.033087 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.033862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.034301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.054291 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:25.055276 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:25.061695 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.062229 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.063676 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.064117 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.069078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-36691729-c10d-4048-b5ad-eb6cc5ca956f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047851 Jun 15 10:36:25.069779 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 335/646] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:25 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:36:25.146016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:25.146681 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:25.153307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.155217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.156303 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.157307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.186002 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:36:25.207951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:25.211709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:25.218083 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6fc70748-2727-4f2c-81bd-01448a3c0caf tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.168995 Jun 15 10:36:25.218660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 312/647] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:25 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:25.278026 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2412e87b-93bb-492f-88f9-f6ddeb0688ec tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 204 len: 0 microversion: 2.1 time: 0.135237 Jun 15 10:36:25.278972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 336/648] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:36:25 2022] DELETE /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:36:25.287643 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:25.288259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:25.295968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.298461 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.299325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:25.299777 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:25.430631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:25.438216 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9fdd6223-9d2b-4342-886d-b6609271b253 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1690 microversion: 2.1 time: 0.155093 Jun 15 10:36:25.438771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 313/649] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:25 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:26.235326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:26.236028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:26.238369 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:26.239028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=6 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:26.245089 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:26.245530 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:26.246284 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:26.246708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:26.380735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:26.388237 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3900dd70-2ef3-4e2d-b61d-b59a4dc10a2f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.157212 Jun 15 10:36:26.388788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 337/650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:26 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:26.455664 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:26.456264 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:26.458573 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:26.464301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:26.464754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:26.465513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:26.465971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:26.591900 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:26.599384 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5c7d873d-a7f5-4ffd-a62c-c674cb6b104f tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1690 microversion: 2.1 time: 0.148091 Jun 15 10:36:26.599951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 314/651] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:26 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:27.405958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:27.407288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:27.413744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:27.414187 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:27.414976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:27.415445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:27.542890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:27.550353 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-401c9b57-0fd7-4711-9677-b0e034f39632 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.148521 Jun 15 10:36:27.551067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 338/652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:27 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:27.615888 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:27.616498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:27.619007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:27.624766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:27.625213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:27.625972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:27.626410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:27.752430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:27.759897 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5ab4f578-5316-4632-af58-65ce3a635188 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1690 microversion: 2.1 time: 0.147788 Jun 15 10:36:27.760459 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 315/653] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:27 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1690 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:28.567355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:28.567986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:28.574502 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:28.574951 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:28.575748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:28.576186 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:28.700501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:28.708480 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-86639563-39eb-4677-a279-f5ba1f3ce3a8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.145029 Jun 15 10:36:28.709040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 339/654] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:28 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:28.777712 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:28.778309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:28.784641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:28.785084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:28.785823 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:28.786249 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:28.914567 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:28.922514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7f5b76f2-e6af-434d-8ee3-726d0c9313f0 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1690 microversion: 2.1 time: 0.148393 Jun 15 10:36:28.923083 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 316/655] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:28 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:29.725311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:29.725925 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:29.732496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:29.732945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:29.733709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:29.734628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:29.867301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:29.874818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-37421bb7-b405-4392-a595-3a051298fc2e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1366 microversion: 2.1 time: 0.153692 Jun 15 10:36:29.876072 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 340/656] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:29 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:29.939310 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:29.939990 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:29.946357 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:29.946806 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:29.947621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:29.948059 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:30.153289 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:30.161320 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f24eb3be-bca5-4613-8cbd-d50c5ae37671 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1690 microversion: 2.1 time: 0.225910 Jun 15 10:36:30.161979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 317/657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:29 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:30.730124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-03718938-b8fd-49ba-b694-9194845e3304 req-435b7b91-cba4-437a-9704-908c840bd8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dc2e258-7d46-483d-b6d9-8c11d75d9b09", "name": "network-vif-deleted", "tag": "b55b6c61-87be-499d-9c71-6698d6514e2d"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:30.748517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-03718938-b8fd-49ba-b694-9194845e3304 req-435b7b91-cba4-437a-9704-908c840bd8f3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:30.748877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-03718938-b8fd-49ba-b694-9194845e3304 req-435b7b91-cba4-437a-9704-908c840bd8f3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:30.761615 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-03718938-b8fd-49ba-b694-9194845e3304 req-435b7b91-cba4-437a-9704-908c840bd8f3 service nova] Creating event network-vif-deleted:b55b6c61-87be-499d-9c71-6698d6514e2d for instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 on hv-cinder-84349 Jun 15 10:36:30.768166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-03718938-b8fd-49ba-b694-9194845e3304 req-435b7b91-cba4-437a-9704-908c840bd8f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043404 Jun 15 10:36:30.768960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 341/658] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:30.892996 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:30.893613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:30.900021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:30.900667 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:30.901507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:30.902207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:31.045611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:31.053850 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-74626d8a-7227-48c1-a37d-6d05482e4f21 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1556 microversion: 2.1 time: 0.165259 Jun 15 10:36:31.054360 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 318/659] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:30 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:31.070772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:31.071411 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:31.077594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:31.078528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:31.079363 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:31.079796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:31.155700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6a24988f-0acb-4a54-a4bb-2097fdadf1d8 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089119 Jun 15 10:36:31.157028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 342/660] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:36:31 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:31.177640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:31.178362 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:31.184828 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:31.185353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:31.186193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:31.186698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:31.222921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:31.223431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:31.223953 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'fault' on Instance uuid 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:31.297682 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:31.306219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-48572158-1dec-4b54-b950-09cec35db0cf tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 200 len: 1336 microversion: 2.1 time: 0.132370 Jun 15 10:36:31.316090 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 319/661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:31 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 1336 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:32.324277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:32.324915 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 2dc2e258-7d46-483d-b6d9-8c11d75d9b09] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:32.331027 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:32.331524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:32.332290 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:32.332901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:32.347635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] HTTP exception thrown: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 could not be found. Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Request method failure captured: Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 HTTP/1.1 Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbT6et4JMqBoWsOdn2Ym9JMKVSX3J81aX_m3gE1UmgYyhNRP-vipwrlrG_5xzsjm6FRel99SIUiGZnTUzewNJHlDm402FnGOBUeoBhuZVaIDt1uXxqXOAD7Yw0JcF1RvoalDzw2pFiC_EMmXWvomPs0TfmHo1HwGmpJwGYPKBn_yQfg Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:36:32.349280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 6d152f74395c4b6cb889058f612d502f Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 could not be found. Jun 15 10:36:32.350889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '2dc2e258-7d46-483d-b6d9-8c11d75d9b09'} Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 could not be found. Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:32.351777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 could not be found. Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 could not be found. Jun 15 10:36:32.353335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:32.354711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Returning 404 to user: Instance 2dc2e258-7d46-483d-b6d9-8c11d75d9b09 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:32.354711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-427bcaf8-514b-43b5-9094-f226a87d9a69 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09" status: 404 len: 111 microversion: 2.1 time: 0.031120 Jun 15 10:36:32.354711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 343/662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:32 2022] GET /compute/v2.1/servers/2dc2e258-7d46-483d-b6d9-8c11d75d9b09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:36:32.359910 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2b0ffd90-dd5c-42c7-8c22-aad85890e729 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '.version_select at 0x7feb3aaac1f0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:32.377253 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2b0ffd90-dd5c-42c7-8c22-aad85890e729 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661791585" status: 202 len: 0 microversion: 2.1 time: 0.021694 Jun 15 10:36:32.377880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 320/663] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jun 15 10:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661791585 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:36:32.798351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-7fa2ca66-4e66-488c-8aad-a4ade38e8e4b req-7afaf859-2678-4b7f-a050-aa25271db7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0264e78-46e5-4622-92f7-b4ea5a4708fd", "tag": "224da4da-f789-4111-bbb8-87943e241db9"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:32.806658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-7fa2ca66-4e66-488c-8aad-a4ade38e8e4b req-7afaf859-2678-4b7f-a050-aa25271db7fb service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:32.807363 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-7fa2ca66-4e66-488c-8aad-a4ade38e8e4b req-7afaf859-2678-4b7f-a050-aa25271db7fb service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:32.819104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-7fa2ca66-4e66-488c-8aad-a4ade38e8e4b req-7afaf859-2678-4b7f-a050-aa25271db7fb service nova] Creating event network-changed:224da4da-f789-4111-bbb8-87943e241db9 for instance b0264e78-46e5-4622-92f7-b4ea5a4708fd on hv-cinder-84349 Jun 15 10:36:32.824219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-7fa2ca66-4e66-488c-8aad-a4ade38e8e4b req-7afaf859-2678-4b7f-a050-aa25271db7fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029488 Jun 15 10:36:32.825188 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 344/664] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:33.914856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:33.915399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:33.921827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:33.922268 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:33.923026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:33.923485 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:33.948564 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c6fbf1ab-f04d-4364-bfba-2fa3636926ae tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/ips" status: 200 len: 152 microversion: 2.20 time: 0.037749 Jun 15 10:36:33.949111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 321/665] 10.222.0.49 () {60 vars in 1288 bytes} [Wed Jun 15 10:36:33 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 10:36:34.130002 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:34.131707 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:34.139336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:34.139986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:34.140914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:34.141354 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:34.192895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fdf1e617-d32c-456b-939c-44e073435424 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067794 Jun 15 10:36:34.193978 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 345/666] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:36:34 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:36:34.275438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:34.276001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:34.282786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:34.283311 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:34.284393 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:34.285157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:34.315908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:36:34.389188 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-61b638cf-9c44-4296-a95b-f50d007a8896 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 204 len: 0 microversion: 2.1 time: 0.117592 Jun 15 10:36:34.389837 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 322/667] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:36:34 2022] DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:36:34.397872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:34.398482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:34.404680 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:34.405129 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:34.405887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:34.406327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:34.533065 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:34.540618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-376ae094-eb38-4fa3-8fc2-3a43f564337d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1674 microversion: 2.1 time: 0.146576 Jun 15 10:36:34.541170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 346/668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:34 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:35.321125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:35.321707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:35.327875 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.328327 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.329713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.330144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.354902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:36:35.426612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cc30b2d2-aec1-4e01-a350-72d58256ed0b tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 204 len: 0 microversion: 2.1 time: 0.109317 Jun 15 10:36:35.427198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 323/669] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:36:35 2022] DELETE /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:36:35.435053 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:35.435790 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:35.442810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.443302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.444072 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.444534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.558195 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:35.558899 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:35.565662 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.566112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.566874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.567345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.571812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:35.574232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:35.581098 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-84575931-1801-4996-9b93-ce2b858c8cd7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1508 microversion: 2.1 time: 0.149808 Jun 15 10:36:35.581916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 347/670] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:35 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:35.699750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:35.707396 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0879fd14-1015-46c2-b949-9bda1b3e39aa tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1674 microversion: 2.1 time: 0.153428 Jun 15 10:36:35.707956 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 324/671] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:35 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:35.964374 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:35.964906 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:35.972772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.973221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.973991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:35.974428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:35.997249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lazy-loading 'flavor' on Instance uuid be43f1ad-ad30-49ed-aca4-d70e0dbf1291 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:36.248958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dc7b6063-6b64-4f35-bf3e-5aeb7139e092 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/action" status: 202 len: 0 microversion: 2.20 time: 0.288364 Jun 15 10:36:36.249574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 348/672] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jun 15 10:36:35 2022] POST /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:36:36.424309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:36.424983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:36.431384 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:36.431827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:36.432579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:36.433005 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:36.561746 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:36.569898 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:36.571412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:36.572558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5eba81f8-5385-4236-b720-f1db8cc97889 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.318897 Jun 15 10:36:36.573109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 325/673] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:36 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:36.599689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:36.600327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:36.606590 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:36.607039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:36.607827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:36.608266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:36.723451 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:36.724064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:36.730034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:36.730479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:36.731270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:36.731738 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:36.741067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:36.748705 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-26e43f24-ab31-4260-a3b0-3095cc47b1c7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1508 microversion: 2.1 time: 0.154401 Jun 15 10:36:36.749473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 349/674] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:36 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:36.858302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:36.865797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2244ec90-9054-4e9e-b7a1-d23fa01b51d9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1674 microversion: 2.1 time: 0.146150 Jun 15 10:36:36.866354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 326/675] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:36 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:37.590991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:37.591623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:37.599811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:37.600365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:37.601002 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:37.601445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:37.726559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:37.734533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:37.736720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:37.737877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6b0d1c81-f852-4c72-9e40-31c0f7db8e9d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.150775 Jun 15 10:36:37.738435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 350/676] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:37 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:37.765817 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:37.766887 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:37.773901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:37.774352 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:37.775152 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:37.775595 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:37.780759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:37.882229 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:37.883110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:37.892069 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:37.893006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:37.893783 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:37.894214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:37.917051 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:37.925206 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c7c1a28f-f120-47d3-881d-f198485c7198 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1508 microversion: 2.1 time: 0.163199 Jun 15 10:36:37.925905 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 327/677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:37 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:38.026333 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:38.034749 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-35746a6e-b40c-43bb-bb0a-d7f597fed857 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1674 microversion: 2.1 time: 0.156490 Jun 15 10:36:38.035337 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 351/678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:37 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:38.757425 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:38.758024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:38.764102 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:38.764549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:38.765298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:38.765730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:38.890166 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:38.898141 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:38.899650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:38.900792 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-601209ed-e316-4afd-b6d6-5cded5892940 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.147248 Jun 15 10:36:38.901349 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 328/679] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:38 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:38.941356 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:38.941968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:38.948495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:38.948946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:38.949708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:38.950145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:39.052482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:39.053090 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:39.059329 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:39.059779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:39.060728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:39.061158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:39.082090 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:39.092023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fb437bb5-2024-4057-bf09-7e2d30c42ace tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1508 microversion: 2.1 time: 0.154424 Jun 15 10:36:39.092745 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 352/680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:38 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:39.362911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:39.370488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1676efce-42c9-4422-b231-125b4fa0763f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1674 microversion: 2.1 time: 0.321809 Jun 15 10:36:39.371044 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 329/681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:39 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1674 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:39.919917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:39.920527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:39.926840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:39.929895 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:39.930902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:39.931378 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:39.946595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-f922a555-ca4b-4cfa-b39b-5dcb7d656144 req-663865cf-73e5-41f5-9b97-ea001d0d4a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe2cfb9-3db4-4587-b3d8-441ba2bf145f", "name": "network-vif-deleted", "tag": "8d18190d-8f93-467b-a941-b38fe1222aae"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:39.956801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-f922a555-ca4b-4cfa-b39b-5dcb7d656144 req-663865cf-73e5-41f5-9b97-ea001d0d4a8e service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:39.957477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-f922a555-ca4b-4cfa-b39b-5dcb7d656144 req-663865cf-73e5-41f5-9b97-ea001d0d4a8e service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:39.971526 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-f922a555-ca4b-4cfa-b39b-5dcb7d656144 req-663865cf-73e5-41f5-9b97-ea001d0d4a8e service nova] Creating event network-vif-deleted:8d18190d-8f93-467b-a941-b38fe1222aae for instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f on hv-cinder-84349 Jun 15 10:36:39.976935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-f922a555-ca4b-4cfa-b39b-5dcb7d656144 req-663865cf-73e5-41f5-9b97-ea001d0d4a8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112565 Jun 15 10:36:39.977620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 353/682] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:40.110191 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:40.110859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:40.117139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:40.117599 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:40.118374 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:40.118812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:40.151001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:40.152017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:40.152465 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'fault' on Instance uuid 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:40.180726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:40.191540 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:40.193340 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:40.195778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c7cfb471-6257-4844-b3c1-432c232c90bb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.279847 Jun 15 10:36:40.196496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 330/683] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:39 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:36:40.207694 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:40.215346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-abead7ee-440c-4ed5-8caf-a315508be9c3 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 200 len: 1312 microversion: 2.1 time: 0.109874 Jun 15 10:36:40.215924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 354/684] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:40 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:40.387871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:40.388468 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:40.394596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:40.395038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:40.395968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:40.396581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:40.494775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:40.502994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ef3fbee7-0827-43b3-ab45-5ff259213ae8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 200 len: 1606 microversion: 2.1 time: 0.118657 Jun 15 10:36:40.515364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 331/685] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:40 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 1606 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:41.213815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:41.214582 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:41.221428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.221877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.222646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.223079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.233301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:41.234021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:41.240998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.241479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.242312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.243118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.258513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] HTTP exception thrown: Instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f could not be found. Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Request method failure captured: Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f HTTP/1.1 Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbT6et4JMqBoWsOdn2Ym9JMKVSX3J81aX_m3gE1UmgYyhNRP-vipwrlrG_5xzsjm6FRel99SIUiGZnTUzewNJHlDm402FnGOBUeoBhuZVaIDt1uXxqXOAD7Yw0JcF1RvoalDzw2pFiC_EMmXWvomPs0TfmHo1HwGmpJwGYPKBn_yQfg Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:36:41.260169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 6d152f74395c4b6cb889058f612d502f Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f could not be found. Jun 15 10:36:41.261399 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '9fe2cfb9-3db4-4587-b3d8-441ba2bf145f'} Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f could not be found. Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:41.262106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f could not be found. Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f could not be found. Jun 15 10:36:41.263261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.266905 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Returning 404 to user: Instance 9fe2cfb9-3db4-4587-b3d8-441ba2bf145f could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:41.266905 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f564f41b-9d93-4270-986b-c973471ac4d8 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f" status: 404 len: 111 microversion: 2.1 time: 0.033455 Jun 15 10:36:41.267274 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 332/686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:41 2022] GET /compute/v2.1/servers/9fe2cfb9-3db4-4587-b3d8-441ba2bf145f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:36:41.272058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:41.272559 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:41.278733 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.279211 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.279978 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.280414 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.305915 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:36:41.362966 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:41.372549 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:41.374261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:41.376206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ab4f124b-0f3b-4061-bfeb-2c9837549e17 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.165537 Jun 15 10:36:41.376821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 355/687] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:41 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:41.398478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-41049ad7-8f44-4421-b998-4c89ba9f2789 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 204 len: 0 microversion: 2.1 time: 0.129872 Jun 15 10:36:41.399255 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 333/688] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:36:41 2022] DELETE /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:36:41.407513 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:41.408113 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:41.414494 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.414966 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.415822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.416261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.520159 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:41.520856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:41.527116 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.527573 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.528331 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:41.528761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:41.542214 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] HTTP exception thrown: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Request method failure captured: Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 HTTP/1.1 Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbVKKZvMV3hnUlfZQOJhXBI0jDgMG-mCeh-VAlXAMdN-RFa5UcRfrinL3_52wlejoPT9-2PxzPgLyAuRyN2lJF65TlFClKGdCmHATrVaZmLtRHYm4GFrI7agSaIks2slULGAnxm7HaD8hIydGhGcKkxUQ3EJs09sNLUVlmceDlaklCg Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:36:41.543867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 9ca22364db8147f2a14f3a0c77f545de Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:36:41.545422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '3b8e51d7-b834-4fe4-8cea-02ce37c5cce2'} Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:41.546294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:36:41.548236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:36:41.549464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Returning 404 to user: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:41.549464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-57262ade-6ff6-402b-ab5c-ac4f43d6a2f7 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 404 len: 111 microversion: 2.1 time: 0.029925 Jun 15 10:36:41.549604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:41.549707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 334/689] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:41 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:36:41.554104 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-299b9bd4-556b-4bed-a522-0c284f23d515 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '.version_select at 0x7feb3aac3ca0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:41.555696 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0f34fba0-d4a0-4afe-990e-8231995c35a7 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.152024 Jun 15 10:36:41.556318 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 356/690] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:41 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:41.579779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-299b9bd4-556b-4bed-a522-0c284f23d515 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041345859" status: 202 len: 0 microversion: 2.1 time: 0.029153 Jun 15 10:36:41.580348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 335/691] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Jun 15 10:36:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041345859 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:36:42.064366 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-0fc02526-3c90-4b94-b744-c51b632abe79 req-0cb94a09-ca3a-45dc-9ef4-2f2d1ea7af58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8e51d7-b834-4fe4-8cea-02ce37c5cce2", "name": "network-vif-deleted", "tag": "a02e7f61-e16c-43e4-9c88-b76eccfa416c"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:42.072290 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-0fc02526-3c90-4b94-b744-c51b632abe79 req-0cb94a09-ca3a-45dc-9ef4-2f2d1ea7af58 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:42.072736 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-0fc02526-3c90-4b94-b744-c51b632abe79 req-0cb94a09-ca3a-45dc-9ef4-2f2d1ea7af58 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:42.083544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-0fc02526-3c90-4b94-b744-c51b632abe79 req-0cb94a09-ca3a-45dc-9ef4-2f2d1ea7af58 service nova] Creating event network-vif-deleted:a02e7f61-e16c-43e4-9c88-b76eccfa416c for instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 on hv-cinder-84349 Jun 15 10:36:42.088316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-0fc02526-3c90-4b94-b744-c51b632abe79 req-0cb94a09-ca3a-45dc-9ef4-2f2d1ea7af58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027701 Jun 15 10:36:42.088891 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 357/692] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:36:42.394981 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:42.395907 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:42.404904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:42.405424 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:42.407629 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:42.408422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:42.439960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f8c1f8d5-6bbb-433c-8070-76f858743288 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: .version_select at 0x7feb3a8d8820>, body: {"keypair": {"name": "tempest-keypair-22362698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOXQrWuei6+yZe1RTc/EHAR8zhVsLkev19NljLZGaMCnHlWlQl79VZSOiTXicXF8FBEXCYHp21Ga2mLaJ/cZ1KcDP2dQsL6GnI0tlKOHqXnlv9rMeoVhmtDvKk7Y+c6zA=="}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:42.454199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-f8c1f8d5-6bbb-433c-8070-76f858743288 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:36:42.458049 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-f8c1f8d5-6bbb-433c-8070-76f858743288 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for user 9ca22364db8147f2a14f3a0c77f545de and project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'key_pairs'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:36:42.481097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f8c1f8d5-6bbb-433c-8070-76f858743288 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045702 Jun 15 10:36:42.481717 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 358/693] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:36:42 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:42.545108 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:42.553358 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:42.554957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:42.556200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2ae438b5-35ec-4846-a6ba-1a9814ec3e94 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.166345 Jun 15 10:36:42.556833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 336/694] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:42 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:42.572958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:42.573895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:42.580540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:42.580985 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:42.581740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:42.582170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:42.729665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:42.740249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aa38a69c-9f2d-45d3-a6b8-6a734cc80e89 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.171025 Jun 15 10:36:42.740980 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 359/695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:42 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:43.573847 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:43.574473 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:43.581357 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:43.581807 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:43.582560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:43.582991 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:43.727206 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:43.735353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:43.737110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:43.738339 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-14079ffa-98f1-468e-b4fe-9da4ab71b297 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.168440 Jun 15 10:36:43.745198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 337/696] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:43 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:43.751246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-982534825", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a0a2aca-16d7-464a-ac23-ad5ba1ba4be6"}], "security_groups": [{"name": "tempest-securitygroup--1862621762"}], "key_name": "tempest-keypair-22362698", "user_data": "}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:43.757018 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:43.757646 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:43.763576 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:43.764021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:43.764770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:43.765203 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:43.856345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] validate_networks() for [('1a0a2aca-16d7-464a-ac23-ad5ba1ba4be6', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:36:43.894150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:43.901531 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f36699a6-225b-4e37-97a1-0cda09b7ca6c tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.148262 Jun 15 10:36:43.902412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 338/697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:43 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:44.256276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:36:44.256729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:36:44.257199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:36:44.257634 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:36:44.258044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:36:44.266801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:44.267288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:44.268082 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:44.268513 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:44.285460 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:36:44.289408 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Getting quotas for user 9ca22364db8147f2a14f3a0c77f545de and project d5320ba7f73d40cb9a6d16225d6660c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:36:44.300885 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:36:44.303114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:36:44.348011 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7d4a15c4-6c3f-4793-bc63-9ac4a8034235 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601568 Jun 15 10:36:44.348647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 360/698] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:36:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:36:44.358336 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-856238e8-34ee-4432-a0c3-472876e7021e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:44.358945 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-856238e8-34ee-4432-a0c3-472876e7021e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:44.415482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-856238e8-34ee-4432-a0c3-472876e7021e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:44.422162 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-856238e8-34ee-4432-a0c3-472876e7021e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1235 microversion: 2.1 time: 0.067519 Jun 15 10:36:44.423400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 339/699] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:44 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1235 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:44.756548 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:44.757195 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:44.764428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:44.765141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:44.766452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:44.766820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:44.902029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:44.913397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:44.914904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:44.916209 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d3f10e5d-598e-4520-95a0-dde860600de6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.163717 Jun 15 10:36:44.916803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 361/700] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:44 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:44.928280 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:44.928900 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:44.935635 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:44.936007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:44.936775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:44.937212 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:45.103529 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:45.111406 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0b1cbc11-fa7a-42a3-99a3-6f29d1991281 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1523 microversion: 2.1 time: 0.197478 Jun 15 10:36:45.112069 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 340/701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:44 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:36:45.440145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:45.440751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:45.446930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:45.447404 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:45.448168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:45.449357 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:45.516638 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-d865982c-17ca-4efc-a75d-f2e98c888025 req-f9db9311-8492-44b9-9352-6201b6e7a6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30aa81b-0ccd-437d-b0dc-401f2ba90533", "name": "network-vif-deleted", "tag": "0e9fd3cd-585e-471d-9874-b29128afe6b7"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:45.519183 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:45.527462 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-857e64f3-8730-4091-bf05-4beba9653107 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1287 microversion: 2.1 time: 0.091722 Jun 15 10:36:45.528088 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-d865982c-17ca-4efc-a75d-f2e98c888025 req-f9db9311-8492-44b9-9352-6201b6e7a6e3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:45.528602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-d865982c-17ca-4efc-a75d-f2e98c888025 req-f9db9311-8492-44b9-9352-6201b6e7a6e3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:45.531261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 362/702] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:45 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:45.544664 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-d865982c-17ca-4efc-a75d-f2e98c888025 req-f9db9311-8492-44b9-9352-6201b6e7a6e3 service nova] Creating event network-vif-deleted:0e9fd3cd-585e-471d-9874-b29128afe6b7 for instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 on hv-cinder-84349 Jun 15 10:36:45.549836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-d865982c-17ca-4efc-a75d-f2e98c888025 req-f9db9311-8492-44b9-9352-6201b6e7a6e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036936 Jun 15 10:36:45.550409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 341/703] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:36:45.934935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:45.935755 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:45.942167 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:45.942619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:45.943415 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:45.943856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:46.074169 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:46.083333 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:46.084938 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:46.086316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-30e23a1d-713b-4a1b-9bce-76bf95ad5b01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.155356 Jun 15 10:36:46.086865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 363/704] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:45 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:46.129064 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:46.129873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:46.136451 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:46.137022 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:46.137878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:46.138422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:46.170826 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:46.171405 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:46.171915 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lazy-loading 'fault' on Instance uuid b30aa81b-0ccd-437d-b0dc-401f2ba90533 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:36:46.218219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d152f74395c4b6cb889058f612d502f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c57bae00b4a0db1d8de0f5017630a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:46.226235 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2975222d-3f78-42a4-a0b2-6ef0f1a91303 tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 200 len: 1312 microversion: 2.1 time: 0.101748 Jun 15 10:36:46.226795 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 342/705] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:46 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:46.544715 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:46.545409 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:46.547441 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:46.552759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:46.553276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:46.554102 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:46.554607 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:46.698069 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:46.706800 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-05aa016e-04e2-49d5-be09-29938c633717 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.165895 Jun 15 10:36:46.707752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 364/706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:46 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:47.106541 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:47.107375 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:47.113717 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.114169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.114935 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.115641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.243932 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:47.244699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] [instance: b30aa81b-0ccd-437d-b0dc-401f2ba90533] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:47.252274 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.252738 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.253516 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.253954 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.258056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:47.270959 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] HTTP exception thrown: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 could not be found. Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Request method failure captured: Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 HTTP/1.1 Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbT6et4JMqBoWsOdn2Ym9JMKVSX3J81aX_m3gE1UmgYyhNRP-vipwrlrG_5xzsjm6FRel99SIUiGZnTUzewNJHlDm402FnGOBUeoBhuZVaIDt1uXxqXOAD7Yw0JcF1RvoalDzw2pFiC_EMmXWvomPs0TfmHo1HwGmpJwGYPKBn_yQfg Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:36:47.272663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/993c57bae00b4a0db1d8de0f5017630a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 993c57bae00b4a0db1d8de0f5017630a Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1163745747 Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 6d152f74395c4b6cb889058f612d502f Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1163745747-project Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 could not be found. Jun 15 10:36:47.274228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'b30aa81b-0ccd-437d-b0dc-401f2ba90533'} Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 could not be found. Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:36:47.275121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 could not be found. Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 could not be found. Jun 15 10:36:47.276773 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:36:47.277958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] Returning 404 to user: Instance b30aa81b-0ccd-437d-b0dc-401f2ba90533 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:36:47.277958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5076dc1e-e42a-4c27-9df4-3beaf68b35ae tempest-ServerRescueNegativeTestJSON-1163745747 tempest-ServerRescueNegativeTestJSON-1163745747-project] 10.222.0.49 "GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533" status: 404 len: 111 microversion: 2.1 time: 0.034341 Jun 15 10:36:47.284226 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 365/707] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:47 2022] GET /compute/v2.1/servers/b30aa81b-0ccd-437d-b0dc-401f2ba90533 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:36:47.315145 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:47.325036 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:47.327107 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:47.329260 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c97f3a0e-adf5-4928-84af-e8622746ea4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.225868 Jun 15 10:36:47.330495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 343/708] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:47 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:47.574594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-9efb6d9d-f7da-4cff-b1d4-7691e6550991 req-833a8a31-b1f7-4c66-87a3-b37c4953138c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0", "tag": "d4223ab9-d65a-4c10-9746-fe9a557c6a3d"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:47.585734 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-9efb6d9d-f7da-4cff-b1d4-7691e6550991 req-833a8a31-b1f7-4c66-87a3-b37c4953138c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.586278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-9efb6d9d-f7da-4cff-b1d4-7691e6550991 req-833a8a31-b1f7-4c66-87a3-b37c4953138c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.598828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-9efb6d9d-f7da-4cff-b1d4-7691e6550991 req-833a8a31-b1f7-4c66-87a3-b37c4953138c service nova] Creating event network-changed:d4223ab9-d65a-4c10-9746-fe9a557c6a3d for instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 on hv-cinder-84349 Jun 15 10:36:47.603763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-9efb6d9d-f7da-4cff-b1d4-7691e6550991 req-833a8a31-b1f7-4c66-87a3-b37c4953138c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034232 Jun 15 10:36:47.604364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 366/709] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:47.724427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:47.725168 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:47.731226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.731679 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.732445 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:47.732881 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:47.934593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:47.942252 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-23570ed4-aefd-4e49-8fa7-80db404410d5 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.221702 Jun 15 10:36:47.943023 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 344/710] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:47 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:48.349014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:48.349700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:48.355896 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:48.356341 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:48.357094 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:48.357520 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:48.582792 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:48.591667 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:48.593221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:48.594986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-489a16d6-ede6-4fac-8b0c-33765101ee1d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.251183 Jun 15 10:36:48.598072 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 367/711] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:48 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:48.959738 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:48.960613 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:48.967955 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:48.968441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:48.969293 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:48.969802 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:49.225988 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:49.230146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:49.235943 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-864bc721-6b79-4d94-9eb8-765ee068da5a tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.280218 Jun 15 10:36:49.245063 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 345/712] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:48 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:49.613323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:49.613938 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:49.622185 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:49.622634 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:49.623561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:49.623993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:49.872782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:49.884526 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:49.886176 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:49.887786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3ce1523e-ec66-4688-bee5-ffc5327d9f76 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.278562 Jun 15 10:36:49.889010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 368/713] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:49 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:50.253896 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:50.254591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:50.262371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:50.263242 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:50.264117 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:50.264677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:50.507569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:50.518496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-acc4e127-cb30-463f-a71d-2e591877c166 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.269420 Jun 15 10:36:50.519829 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 346/714] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:50 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:50.907987 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:50.908679 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:50.915007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:50.915608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:50.916448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:50.916962 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:51.058964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:51.067473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:51.069799 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:51.070180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c6b956bd-fd0e-467a-9e74-fa0fe352e29a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.167935 Jun 15 10:36:51.070728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 369/715] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:50 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:51.536226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:51.537472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:51.544392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:51.544836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:51.546026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:51.546684 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:51.705035 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:51.713624 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-15b47a17-cab8-4d81-836a-ebc85a1e7a7f tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.182092 Jun 15 10:36:51.714194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 347/716] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:51 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:52.088074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:52.088685 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:52.095976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:52.096420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:52.097177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:52.097608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:52.230889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:52.241214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:52.242709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:52.243903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ed94eab5-9c8b-49c3-8cce-46f257d23307 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.159730 Jun 15 10:36:52.244492 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 370/717] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:52 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:52.729608 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:52.730208 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:52.737642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:52.738079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:52.738824 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:52.739292 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:52.868703 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:52.876176 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f92cfd02-4c94-4fb4-be16-287dbadc74c2 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.150361 Jun 15 10:36:52.876730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 348/718] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:52 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:53.189723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-35922bc6-27e3-4240-b895-8b5ba09ceb52 req-e1bf49bf-cd5c-4be9-8613-8ebbf1a84fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0", "name": "network-vif-plugged", "status": "completed", "tag": "d4223ab9-d65a-4c10-9746-fe9a557c6a3d"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:53.197702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-35922bc6-27e3-4240-b895-8b5ba09ceb52 req-e1bf49bf-cd5c-4be9-8613-8ebbf1a84fb4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:53.198146 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-35922bc6-27e3-4240-b895-8b5ba09ceb52 req-e1bf49bf-cd5c-4be9-8613-8ebbf1a84fb4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:53.209326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-35922bc6-27e3-4240-b895-8b5ba09ceb52 req-e1bf49bf-cd5c-4be9-8613-8ebbf1a84fb4 service nova] Creating event network-vif-plugged:d4223ab9-d65a-4c10-9746-fe9a557c6a3d for instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 on hv-cinder-84349 Jun 15 10:36:53.214395 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-35922bc6-27e3-4240-b895-8b5ba09ceb52 req-e1bf49bf-cd5c-4be9-8613-8ebbf1a84fb4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148493 Jun 15 10:36:53.214926 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 371/719] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:53.262225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:53.262825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:53.270694 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:53.271913 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:53.273033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:53.273475 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:53.703524 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:53.711533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:53.713226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:53.714169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a86c3b50-5951-4155-b376-8d42fdbd26ff tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.456429 Jun 15 10:36:53.714740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 349/720] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:53 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:53.893922 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:53.894903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:53.902625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:53.903080 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:53.903890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:53.904310 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:54.044548 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:54.052738 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5b10fc6b-8b75-4d22-b268-6e610f1bb3c6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.163572 Jun 15 10:36:54.062108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 372/721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:53 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:54.733663 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:54.734341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:54.736697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:54.742713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:54.743203 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:54.743992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:54.744430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:54.878062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:54.886514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:54.888045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:54.889223 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7ee1e22c-4253-4b31-abad-5497842ed9f5 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1743 microversion: 2.20 time: 0.159454 Jun 15 10:36:54.889768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 350/722] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:54 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:55.069643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:55.070261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:55.072674 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:55.073506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=10 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:55.079880 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:55.080265 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:55.081027 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:55.081458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:55.214383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:55.221927 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0f3e3fd6-6fe7-414c-923a-1690a5c5b6c0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1361 microversion: 2.1 time: 0.156417 Jun 15 10:36:55.222487 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 373/723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:55 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:55.908845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:55.909471 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:55.911824 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:55.917095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:55.917544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:55.918306 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:55.918744 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:56.050793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:56.058757 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:56.060303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:56.061457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9d8db058-4ac4-431c-8117-238e2a72b9d7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1743 microversion: 2.20 time: 0.157131 Jun 15 10:36:56.062009 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 351/724] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:55 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:56.238479 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:56.239101 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:56.245631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:56.246076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:56.246862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:56.247330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:56.533132 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:56.541016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-85829111-37d4-47d2-b8e9-29423a2bbd61 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1547 microversion: 2.1 time: 0.306383 Jun 15 10:36:56.541568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 374/725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:36:56 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1547 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:36:56.557348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:56.557845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:56.564315 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:56.564761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:56.565512 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:56.565942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:56.643598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c41dcb4b-4001-440b-9144-78f0f24f5f9b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089965 Jun 15 10:36:56.644191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 352/726] 10.222.0.49 () {58 vars in 1274 bytes} [Wed Jun 15 10:36:56 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:57.079401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:57.080000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:57.086132 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:57.086575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:57.087351 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:57.087778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:57.216465 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:57.226092 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:57.227649 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:57.228803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8176aee7-fde6-40a4-9fde-ef6c680fa574 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1743 microversion: 2.20 time: 0.153431 Jun 15 10:36:57.229352 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 375/727] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:57 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:57.540705 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-7d6817a9-2c01-4fcc-85d9-547f4a22efb0 req-34618474-d7be-4b41-9f26-256a983c0996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0", "tag": "d4223ab9-d65a-4c10-9746-fe9a557c6a3d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:57.548869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-7d6817a9-2c01-4fcc-85d9-547f4a22efb0 req-34618474-d7be-4b41-9f26-256a983c0996 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:57.549383 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-7d6817a9-2c01-4fcc-85d9-547f4a22efb0 req-34618474-d7be-4b41-9f26-256a983c0996 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:57.560643 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-7d6817a9-2c01-4fcc-85d9-547f4a22efb0 req-34618474-d7be-4b41-9f26-256a983c0996 service nova] Creating event network-changed:d4223ab9-d65a-4c10-9746-fe9a557c6a3d for instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 on hv-cinder-84349 Jun 15 10:36:57.566120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-7d6817a9-2c01-4fcc-85d9-547f4a22efb0 req-34618474-d7be-4b41-9f26-256a983c0996 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029949 Jun 15 10:36:57.566702 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 353/728] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:36:58.247746 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:58.248176 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:58.255532 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:58.255977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:58.256733 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:58.257160 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:58.400243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:58.409515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:58.410978 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:58.413320 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b7b06b1d-1619-4c08-9975-fc4cc0d9ce99 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1743 microversion: 2.20 time: 0.169662 Jun 15 10:36:58.414086 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 376/729] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:58 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:59.442618 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:36:59.443483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:36:59.450794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:59.451202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:59.451964 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:59.452393 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:59.594404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:59.609601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:59.613542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:36:59.615067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4d47c5ee-3d15-477e-90c6-289e328f4d39 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.185077 Jun 15 10:36:59.616019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 354/730] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:36:59 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:36:59.839713 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-85b71a0c-6094-4f57-b14b-92618c483dc0 req-736a35c1-93c8-4ae7-88ff-cf4ee99447ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "name": "network-vif-plugged", "status": "completed", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:36:59.855486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-85b71a0c-6094-4f57-b14b-92618c483dc0 req-736a35c1-93c8-4ae7-88ff-cf4ee99447ad service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:36:59.857013 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-85b71a0c-6094-4f57-b14b-92618c483dc0 req-736a35c1-93c8-4ae7-88ff-cf4ee99447ad service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:36:59.889765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-85b71a0c-6094-4f57-b14b-92618c483dc0 req-736a35c1-93c8-4ae7-88ff-cf4ee99447ad service nova] Creating event network-vif-plugged:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:36:59.896074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-85b71a0c-6094-4f57-b14b-92618c483dc0 req-736a35c1-93c8-4ae7-88ff-cf4ee99447ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059890 Jun 15 10:36:59.897210 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 377/731] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:37:00.634939 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:00.636169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:00.642479 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:00.642924 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:00.643776 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:00.644370 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:00.798854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:00.809649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:00.811651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:00.813343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f537a52a-fcca-46d9-a3ad-30e409294ff6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.182210 Jun 15 10:37:00.813933 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 355/732] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:00 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:01.833722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:01.834318 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:01.842405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:01.842856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:01.844399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:01.844873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:02.010724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:02.023216 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:02.024962 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:02.026620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a616544d-d5ff-4659-b77f-58309a37518e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.197724 Jun 15 10:37:02.027710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 378/733] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:01 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:03.045126 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:03.045755 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:03.055774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:03.056630 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:03.057664 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:03.058348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:03.269853 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:03.293271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:03.299376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:03.300594 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-352001bb-1623-4e8a-9a64-2a4dd54b7657 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.259333 Jun 15 10:37:03.301149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 356/734] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:03 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:04.319238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:04.321472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:04.329571 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:04.332150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:04.334103 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:04.334626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:04.487714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:04.496006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:04.500920 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:04.502458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d5748a2e-837a-4f7a-a311-8849281aa2db tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.188559 Jun 15 10:37:04.503532 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 379/735] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:04 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:05.520843 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:05.521496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:05.534616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:05.535063 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:05.535866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:05.536288 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:05.708843 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:05.722297 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:05.723874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:05.725231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7b5c26a1-b5b1-4ae4-bc51-9650769e6c6d tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.208388 Jun 15 10:37:05.725944 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 357/736] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:05 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:06.745060 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:06.746357 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:06.756472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:06.763701 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:06.764892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:06.766005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:06.989203 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:06.998023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:06.999926 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:07.001348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f928ea8d-7bdd-476d-a091-534eba9e5ddf tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.261006 Jun 15 10:37:07.002451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 380/737] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:06 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:37:08.020587 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:08.022094 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:08.029673 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:08.030398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:08.031938 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:08.032394 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:08.211491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:08.230335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:08.231861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:08.236517 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-eb28237e-a6cb-44ce-9091-5948a47e190b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.220067 Jun 15 10:37:08.237669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 358/738] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:08 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:09.254871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:09.255520 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:09.262295 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:09.262742 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:09.263558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:09.263989 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:09.397847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:09.407472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:09.408974 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:09.410420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fee4340a-af64-41e2-aefb-81a0286c6b43 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1738 microversion: 2.20 time: 0.159471 Jun 15 10:37:09.411433 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 381/739] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:09 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:10.429855 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:10.430441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:10.437582 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:10.438025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:10.438773 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:10.439228 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:10.572871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:10.580861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:10.582338 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:10.583503 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-70b5c8fa-76b8-4cbe-a671-21f8350c0256 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1720 microversion: 2.20 time: 0.157585 Jun 15 10:37:10.584046 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 359/740] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:10 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:11.601646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:11.602249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:11.608911 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:11.609354 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:11.610110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:11.610541 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:11.741242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:11.749828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:11.751350 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:11.752509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-18315a2e-5ba8-4914-a661-239efa5c691e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1720 microversion: 2.20 time: 0.154766 Jun 15 10:37:11.753057 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 382/741] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:11 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:12.770106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:12.770714 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:12.777574 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:12.778014 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:12.778769 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:12.779229 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:12.908799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:12.916446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:12.917923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:12.919054 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f30e5e57-f37e-4a7c-80c0-69147ce9ca5a tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1720 microversion: 2.20 time: 0.152935 Jun 15 10:37:12.919623 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 360/742] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:12 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:13.825211 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-9317d2bf-c7cd-4395-8590-9005b4d53b8c req-0fda7796-b63e-4285-9433-dacce4d0a2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "name": "network-vif-unplugged", "status": "completed", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:13.837859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-9317d2bf-c7cd-4395-8590-9005b4d53b8c req-0fda7796-b63e-4285-9433-dacce4d0a2e4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:13.838253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-9317d2bf-c7cd-4395-8590-9005b4d53b8c req-0fda7796-b63e-4285-9433-dacce4d0a2e4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:13.854302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-9317d2bf-c7cd-4395-8590-9005b4d53b8c req-0fda7796-b63e-4285-9433-dacce4d0a2e4 service nova] Creating event network-vif-unplugged:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:37:13.864772 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-9317d2bf-c7cd-4395-8590-9005b4d53b8c req-0fda7796-b63e-4285-9433-dacce4d0a2e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045044 Jun 15 10:37:13.866121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 383/743] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:13.938669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:13.939294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:13.946050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:13.946493 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:13.947346 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:13.947940 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:14.082550 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:14.090851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:14.092332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:14.093505 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-363c661e-918b-4e45-85e6-160fa1842a98 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1723 microversion: 2.20 time: 0.159201 Jun 15 10:37:14.094053 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 361/744] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:13 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:14.111479 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e24defbf-e07e-4760-8b2c-1af4c3a78130"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:14.112619 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:14.118784 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:14.119268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:14.120022 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:14.120452 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:14.213312 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:14.403724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fecc316a-2cd2-454c-a903-f3d62e41b785 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296654 Jun 15 10:37:14.404325 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 384/745] 10.222.0.49 () {62 vars in 1363 bytes} [Wed Jun 15 10:37:14 2022] POST /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 10:37:14.514440 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:14.514958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:14.520808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:14.521250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:14.521992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:14.522415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:14.609910 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:16.953798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:16.954306 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:16.956233 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=42 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:16.962286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:16.962735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:16.963530 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:16.963983 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:16.986156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2403bb12-2c2f-4548-9c19-29bbb9664296 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/ips" status: 200 len: 150 microversion: 2.1 time: 0.193760 Jun 15 10:37:16.986695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 385/746] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:37:16 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/ips => generated 150 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:37:17.277891 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e5402283-bf99-4031-837d-fb23bc73cdc7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-volume_attachments/e24defbf-e07e-4760-8b2c-1af4c3a78130" status: 202 len: 0 microversion: 2.20 time: 2.767223 Jun 15 10:37:17.278483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 362/747] 10.222.0.49 () {60 vars in 1456 bytes} [Wed Jun 15 10:37:14 2022] DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-volume_attachments/e24defbf-e07e-4760-8b2c-1af4c3a78130 => generated 0 bytes in 2768 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:37:17.336451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:17.337019 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:17.343139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:17.343621 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:17.344375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:17.344813 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:17.432986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c9a0f0a9-cb16-4c6f-bfc0-776ce79a87a4 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "POST /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/action" status: 202 len: 0 microversion: 2.20 time: 0.100290 Jun 15 10:37:17.433755 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 386/748] 10.222.0.49 () {62 vars in 1318 bytes} [Wed Jun 15 10:37:17 2022] POST /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:37:17.442250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:17.442979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:17.449898 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:17.450345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:17.451143 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:17.451749 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:17.583645 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:17.591916 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:17.594140 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:17.595279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bf984c87-9277-4af4-93f8-2dd08264ee2c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1671 microversion: 2.20 time: 0.156905 Jun 15 10:37:17.595825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 363/749] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:17 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:37:18.302579 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b77573fd-7f40-4484-8007-5126a9991146"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:18.303961 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:18.311214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:18.312190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:18.313097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:18.313527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:18.597586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2c2da37a-a18a-4ee5-b392-4010d0d9f55f tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "POST /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298833 Jun 15 10:37:18.598181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 387/750] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:37:18 2022] POST /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:18.613958 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:18.614622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:18.621509 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:18.622212 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:18.623367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:18.624673 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:18.768624 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:18.778147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:18.779683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:18.780856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ef0b782b-00c0-4346-b93d-9aeb31720b58 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1671 microversion: 2.20 time: 0.171473 Jun 15 10:37:18.781392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 364/751] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:18 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:19.800696 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:19.801608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:19.808162 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:19.808608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:19.809361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:19.809793 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:19.946829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:19.955050 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:19.956597 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:19.957752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-622b539b-b7b0-4af9-8411-b2e7f010bb91 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.162707 Jun 15 10:37:19.958303 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 388/752] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:19 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:37:20.975389 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:20.975985 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:20.982395 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:20.982848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:20.983607 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:20.984033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:21.112301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:21.120090 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:21.121563 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:21.122697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-711357e1-cb43-4e93-b96a-f6e8c006541e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.151178 Jun 15 10:37:21.123267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 365/753] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:20 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:22.140618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:22.141261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:22.147818 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:22.148263 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:22.149020 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:22.149455 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:22.277031 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:22.285500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:22.286994 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:22.288190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3b245501-eb91-4cd4-9949-8770704c8746 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.151486 Jun 15 10:37:22.288742 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 389/754] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:22 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:23.306602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:23.308079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:23.329463 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:23.329933 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:23.330731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:23.331198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:23.467001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:23.476644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:23.478138 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:23.479323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-afeadf9f-2517-416b-8c74-60d355d1c46f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.177200 Jun 15 10:37:23.480195 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 366/755] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:23 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:24.497798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:24.498610 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:24.505909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:24.506357 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:24.507155 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:24.507595 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:24.642611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:24.651405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:24.652918 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:24.654092 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-214429a6-4e91-4cb5-a16d-f6e7ed18f2e0 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.160584 Jun 15 10:37:24.654824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 390/756] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:24 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:25.674236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:25.674867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:25.681519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:25.681971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:25.682732 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:25.683193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:25.823029 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:25.831736 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:25.833246 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:25.834411 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-753a9a5d-12b6-4259-92e2-bd1f3f17fefb tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.164637 Jun 15 10:37:25.834964 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 367/757] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:25 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:26.854607 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:26.856777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:26.865555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:26.866149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:26.867038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:26.867556 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:27.009017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:27.019390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:27.021061 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:27.022309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e894ee4e-d82a-4523-9369-ff388675b5d8 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.173111 Jun 15 10:37:27.022996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 391/758] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:26 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:28.042187 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:28.043816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:28.051392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=34 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:28.053686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:28.054242 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:28.055269 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:28.055768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:28.196955 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:28.210155 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:28.211809 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:28.212972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5f2bc63f-92a0-48a7-9b16-d2672a860c8b tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.175549 Jun 15 10:37:28.213621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 368/759] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:28 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:29.231543 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:29.232837 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:29.241849 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:29.242815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:29.243774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:29.244291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:29.383391 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:29.392224 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:29.393730 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:29.394908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-43bf7b89-2783-41f6-a9ff-79f7f22adab6 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.167272 Jun 15 10:37:29.395521 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 392/760] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:29 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 10:37:30.413763 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:30.414446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:30.420647 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:30.421093 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:30.421859 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:30.422290 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:30.556758 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:30.565821 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:30.567344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:30.568803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-30f1162e-f21d-42f3-8ab5-e7e8a69206e9 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.158946 Jun 15 10:37:30.569630 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 369/761] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:30 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:31.587327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:31.587936 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:31.594541 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:31.595651 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:31.596412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:31.596881 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:31.730515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:31.738389 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:31.739913 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:31.741075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-115471b6-c7f9-4d74-aa88-6431268f0289 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.157814 Jun 15 10:37:31.741618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 393/762] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:31 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:32.758937 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:32.759506 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:32.766067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:32.766507 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:32.767947 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:32.768381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:32.898310 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:32.906792 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:32.908324 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:32.909512 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-af59c554-eb39-4fe6-bcf4-a09f85c0b764 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.154527 Jun 15 10:37:32.910060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 370/763] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:32 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:33.927131 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:33.927741 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:33.934245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:33.934686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:33.935472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:33.935902 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:34.063105 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:34.071624 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:34.073109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:34.074264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fe3ea386-5310-467a-b44d-f4d1a09c9644 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.151103 Jun 15 10:37:34.074815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 394/764] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:33 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:35.091589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:35.092261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:35.099503 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:35.099959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:35.100726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:35.101165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:35.230271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:35.238285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:35.239807 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:35.240968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-050abfad-355e-42c7-9ff5-f39e97e3915f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.153228 Jun 15 10:37:35.241542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 371/765] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:35 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:36.261447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:36.262318 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:36.270194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:36.270720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:36.271604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:36.272104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:36.432120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:36.441780 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:36.444850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:36.446289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-19a9290e-84ac-4f79-922e-03aa0227b2bd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.191499 Jun 15 10:37:36.446859 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 395/766] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:36 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:36.839869 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:36.840405 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:36.847559 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:36.847994 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:36.848760 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:36.849197 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:36.934082 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lazy-loading 'services' on Instance uuid b0264e78-46e5-4622-92f7-b4ea5a4708fd {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:37:37.004836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6b4a15b5-47f0-44b5-be02-1b7cb9bd2661 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments/b77573fd-7f40-4484-8007-5126a9991146" status: 202 len: 0 microversion: 2.1 time: 0.169734 Jun 15 10:37:37.005426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 372/767] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:37:36 2022] DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments/b77573fd-7f40-4484-8007-5126a9991146 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:37:37.013659 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:37.014637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:37.021366 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:37.021822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:37.022578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:37.023014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:37.051227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-29e17a23-c168-461d-be08-e5c6f9aea926 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041539 Jun 15 10:37:37.051767 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 396/768] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:37:37 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:37:37.464967 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:37.465655 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:37.471878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:37.472326 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:37.473077 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:37.473509 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:37.600432 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:37.608424 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:37.609914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:37.611057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ac4699b9-83c3-49e7-8b31-336bff08dd18 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.150492 Jun 15 10:37:37.612154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 373/769] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:37 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:38.061981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:38.063023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:38.069621 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:38.070085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:38.070830 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:38.071303 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:38.073823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=88,nova_cell1:UPDATE=7 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:38.103903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-87f2d76e-023e-41fc-a10b-c10954521486 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Jun 15 10:37:38.104459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 397/770] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:37:38 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:38.629916 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:38.631147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:38.637692 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:38.638143 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:38.638924 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:38.639388 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:38.764923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:38.773427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:38.775000 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:38.776462 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d155ab26-07a3-469c-817f-2099313abc6e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.151089 Jun 15 10:37:38.777007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 374/771] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:38 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:39.115835 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:39.116752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:39.123112 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.123572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.124361 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.124793 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.153591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d6d0b710-e8a9-4900-8cae-16a0fe8b5239 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042175 Jun 15 10:37:39.154144 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 398/772] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:37:39 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:37:39.212515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:39.213021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:39.218907 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.219391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.220154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.220588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.247021 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:37:39.296222 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:39.339540 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a3a553ff-8adc-47c9-8f23-f2223302a3e3 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 204 len: 0 microversion: 2.1 time: 0.130367 Jun 15 10:37:39.340525 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 375/773] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:37:39 2022] DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:37:39.349043 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:39.349648 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:39.358672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.359192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.359899 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.360362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.515332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:39.523909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ecb4fd7a-56c8-4ede-8159-482edde624fa tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1681 microversion: 2.1 time: 0.178869 Jun 15 10:37:39.524663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 399/774] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:39 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:37:39.794457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:39.795182 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:39.802364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.802815 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.803620 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:39.804057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:39.981823 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:39.992563 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:39.994316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:39.995757 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8b7be136-db14-47ce-b721-ffc296b0b348 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.205661 Jun 15 10:37:39.996523 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 376/775] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:39 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:40.025866 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-f8f4911e-900c-442d-b5d4-552e91834f6c req-cc1bbe30-0dd2-4619-9f65-d640fbf2444c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "name": "network-vif-plugged", "status": "completed", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:40.034257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-f8f4911e-900c-442d-b5d4-552e91834f6c req-cc1bbe30-0dd2-4619-9f65-d640fbf2444c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:40.034977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-f8f4911e-900c-442d-b5d4-552e91834f6c req-cc1bbe30-0dd2-4619-9f65-d640fbf2444c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:40.046568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-f8f4911e-900c-442d-b5d4-552e91834f6c req-cc1bbe30-0dd2-4619-9f65-d640fbf2444c service nova] Creating event network-vif-plugged:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:37:40.051999 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-f8f4911e-900c-442d-b5d4-552e91834f6c req-cc1bbe30-0dd2-4619-9f65-d640fbf2444c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030225 Jun 15 10:37:40.052807 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 400/776] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:40.541441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:40.542045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:40.548094 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:40.548541 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:40.549860 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:40.550300 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:40.689192 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:40.697488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7592444f-b0f7-43c9-9562-6381e17905e2 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1681 microversion: 2.1 time: 0.159807 Jun 15 10:37:40.698052 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 377/777] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:40 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:37:41.015655 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:41.016482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:41.022860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:41.023552 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:41.024680 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:41.025125 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:41.160106 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:41.169036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:41.170662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:41.172325 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-212e968c-5f92-4c4c-8eab-bb2415de4f67 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.161939 Jun 15 10:37:41.172881 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 401/778] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:41 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:41.714371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:41.714969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:41.722345 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:41.722790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:41.724056 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:41.724487 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:41.954614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:41.962316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f23c88ff-20d8-4e78-a6d1-5f412cdc9e79 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1681 microversion: 2.1 time: 0.251701 Jun 15 10:37:41.963008 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 378/779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:41 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:37:42.190924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:42.191671 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:42.197830 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:42.198285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:42.199054 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:42.199534 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:42.338311 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:42.348360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:42.349887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:42.351775 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f81ac81b-67ed-44d0-bd73-a1156136ef4e tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.164857 Jun 15 10:37:42.352495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 402/780] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:42 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:42.382832 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-1f26f6b7-67b8-4459-8824-edd40cd835c5 req-0e01b96c-a96f-4612-8c8e-838c5889cfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0264e78-46e5-4622-92f7-b4ea5a4708fd", "name": "network-vif-deleted", "tag": "224da4da-f789-4111-bbb8-87943e241db9"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:42.392193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1f26f6b7-67b8-4459-8824-edd40cd835c5 req-0e01b96c-a96f-4612-8c8e-838c5889cfd8 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:42.393209 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1f26f6b7-67b8-4459-8824-edd40cd835c5 req-0e01b96c-a96f-4612-8c8e-838c5889cfd8 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:42.404149 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-1f26f6b7-67b8-4459-8824-edd40cd835c5 req-0e01b96c-a96f-4612-8c8e-838c5889cfd8 service nova] Creating event network-vif-deleted:224da4da-f789-4111-bbb8-87943e241db9 for instance b0264e78-46e5-4622-92f7-b4ea5a4708fd on hv-cinder-84349 Jun 15 10:37:42.409470 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-1f26f6b7-67b8-4459-8824-edd40cd835c5 req-0e01b96c-a96f-4612-8c8e-838c5889cfd8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 Jun 15 10:37:42.410359 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 379/781] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:42.979388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:42.980204 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:42.986474 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:42.987015 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:42.987912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:42.988683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:43.024177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:43.024847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:43.025803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lazy-loading 'fault' on Instance uuid b0264e78-46e5-4622-92f7-b4ea5a4708fd {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:37:43.073466 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b720a2d0854d218272390205887100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b683b2d399b54484aa5820537038b8af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:43.088276 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a197cae9-f883-4df5-8dad-2d0534d1c05c tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 200 len: 1331 microversion: 2.1 time: 0.112630 Jun 15 10:37:43.089581 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 403/782] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:42 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:37:43.371178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:43.372881 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:43.382348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:43.382873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:43.383753 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:43.384207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:43.541539 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:43.554893 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:43.558020 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:43.559704 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-96fa3caf-087a-4df0-84d4-215b54c054d2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1729 microversion: 2.20 time: 0.193475 Jun 15 10:37:43.560778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 380/783] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:43 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:44.108300 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:44.108857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:44.115390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:44.115843 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:44.116600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:44.117035 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:44.131556 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd HTTP/1.1 Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:37:44.133170 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:44.134737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'b0264e78-46e5-4622-92f7-b4ea5a4708fd'} Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:44.135691 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:44.137154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:44.138468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:44.138468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8a67bab1-29bb-423f-82ef-aba535e256a6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 404 len: 111 microversion: 2.1 time: 0.030252 Jun 15 10:37:44.138468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 404/784] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:44 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:37:44.143908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-924a0438-a18d-4a24-8552-29868eb6083a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '.version_select at 0x7feb3a9c31f0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:44.161143 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-924a0438-a18d-4a24-8552-29868eb6083a tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501060140" status: 202 len: 0 microversion: 2.1 time: 0.021512 Jun 15 10:37:44.161691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 381/785] 10.222.0.49 () {58 vars in 1217 bytes} [Wed Jun 15 10:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501060140 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:37:44.577712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:44.578330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:44.585191 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:44.585644 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:44.586409 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:44.586846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:44.731270 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:44.740457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:44.741972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:37:44.743174 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-26290c4e-2f94-4e49-8d9c-52bb68699722 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1716 microversion: 2.20 time: 0.169390 Jun 15 10:37:44.743727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 405/786] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:37:44 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:37:45.902693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.903312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.909114 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.909558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.910311 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.910743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.924663 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd HTTP/1.1 Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:37:45.926232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.927846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': 'b0264e78-46e5-4622-92f7-b4ea5a4708fd'} Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:45.928730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.930851 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.932750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:45.932750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-93f312a4-78cb-4b91-a8d0-cb9ac8029e9b tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 404 len: 111 microversion: 2.1 time: 0.029490 Jun 15 10:37:45.932750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 382/787] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:37:45 2022] DELETE /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:45.938249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:45.938940 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: b0264e78-46e5-4622-92f7-b4ea5a4708fd] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:45.946392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.946844 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.947806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:45.948245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:45.961774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd HTTP/1.1 Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:37:45.963335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.964875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'b0264e78-46e5-4622-92f7-b4ea5a4708fd'} Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:45.965732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. Jun 15 10:37:45.967154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:45.968972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance b0264e78-46e5-4622-92f7-b4ea5a4708fd could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:45.968972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-473107b2-c89e-48fa-acb0-7fbcca8a46f6 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd" status: 404 len: 111 microversion: 2.1 time: 0.030361 Jun 15 10:37:45.968972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 406/788] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:45 2022] GET /compute/v2.1/servers/b0264e78-46e5-4622-92f7-b4ea5a4708fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:47.098560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:47.099057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:47.105983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.106420 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.107213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.107649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.121568 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 HTTP/1.1 Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:37:47.123111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.124660 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': 'c41bb315-40ff-4372-90e4-b8f405548765'} Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:47.125488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.126987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.129061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:47.129061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-22860dfb-9db3-455c-867b-3ae9f615cfc7 tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 404 len: 111 microversion: 2.1 time: 0.030066 Jun 15 10:37:47.129061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 383/789] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:37:47 2022] DELETE /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:47.133435 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:47.134048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: c41bb315-40ff-4372-90e4-b8f405548765] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:47.138355 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=48 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:47.142433 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.142889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.143699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.144322 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.158555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 HTTP/1.1 Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:37:47.160108 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.161658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'c41bb315-40ff-4372-90e4-b8f405548765'} Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:47.162525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. Jun 15 10:37:47.163916 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.165147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance c41bb315-40ff-4372-90e4-b8f405548765 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:47.165147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9fa26471-8048-4ed7-974b-f09536b0a43d tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765" status: 404 len: 111 microversion: 2.1 time: 0.031924 Jun 15 10:37:47.165147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 407/790] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:47 2022] GET /compute/v2.1/servers/c41bb315-40ff-4372-90e4-b8f405548765 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:47.169797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:47.170290 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:47.176802 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.177265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.178150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.178681 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.193495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e HTTP/1.1 Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:37:47.195016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.196579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '6e49255f-b081-437b-9505-114a5239096e'} Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:47.197577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.198983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.200734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:47.200734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-30fd8ea0-e2ac-4d93-b402-0463f93f89ae tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 404 len: 111 microversion: 2.1 time: 0.030427 Jun 15 10:37:47.200734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 384/791] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:37:47 2022] DELETE /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:47.204578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:47.205211 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 6e49255f-b081-437b-9505-114a5239096e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:47.211327 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.211752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.212506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:47.212941 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:47.226686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e HTTP/1.1 Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:37:47.228245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.229578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '6e49255f-b081-437b-9505-114a5239096e'} Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:47.230291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. Jun 15 10:37:47.232706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:47.234625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance 6e49255f-b081-437b-9505-114a5239096e could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:47.234625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1e81e240-6a05-44a7-bb33-ecfecca4f52e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e" status: 404 len: 111 microversion: 2.1 time: 0.028912 Jun 15 10:37:47.234625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 408/792] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:47 2022] GET /compute/v2.1/servers/6e49255f-b081-437b-9505-114a5239096e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:48.369175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:48.369671 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:48.379466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:48.379849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:48.380648 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:48.381080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:48.395700 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c HTTP/1.1 Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:37:48.397344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.398921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '1af6cc0a-d588-4a98-a82a-56d49cd2c55c'} Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:48.399836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.401724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.403376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:48.403376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-babaf1fc-6a9d-4d17-9513-3c66ff9a9b9e tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 404 len: 111 microversion: 2.1 time: 0.033417 Jun 15 10:37:48.403376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 385/793] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:37:48 2022] DELETE /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:48.407343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:48.407951 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] [instance: 1af6cc0a-d588-4a98-a82a-56d49cd2c55c] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:48.414578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:48.415024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:48.415830 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:48.416249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:48.430150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] HTTP exception thrown: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Request method failure captured: Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c HTTP/1.1 Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUHdPX9vvNbWpV6yP9FZR6xgoIvSbxvsPULjd8_BTFz7G5JIwULkT09A7-3I73WgiWvRvDGZqS1qG9Ci1HNNNLeoLwtD2CeQfpA-S4ei0Xso8s24E1ZqPXsDsVgYvlEdbHYovBvZHA3FxgwhOmI0_ef9v7VUNTdHZc7OzMQssu5Z7k Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:37:48.431699 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b683b2d399b54484aa5820537038b8af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b683b2d399b54484aa5820537038b8af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b683b2d399b54484aa5820537038b8af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: b683b2d399b54484aa5820537038b8af Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1753283860 Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 14b720a2d0854d218272390205887100 Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeNegativeTest-1753283860-project Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.433335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '1af6cc0a-d588-4a98-a82a-56d49cd2c55c'} Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:37:48.434239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. Jun 15 10:37:48.435888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:37:48.437528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] Returning 404 to user: Instance 1af6cc0a-d588-4a98-a82a-56d49cd2c55c could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:37:48.437528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-af2f42bb-8ad5-46be-a38b-542cb1c8f2ee tempest-AttachVolumeNegativeTest-1753283860 tempest-AttachVolumeNegativeTest-1753283860-project] 10.222.0.49 "GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c" status: 404 len: 111 microversion: 2.1 time: 0.029569 Jun 15 10:37:48.437528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 409/794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:37:48 2022] GET /compute/v2.1/servers/1af6cc0a-d588-4a98-a82a-56d49cd2c55c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:37:53.089605 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:37:53.090095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:53.096444 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:53.096895 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:53.097786 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:53.098224 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:53.121432 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5f3fdbb4-ffbd-47bd-83de-84d96c0a538c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/ips" status: 200 len: 145 microversion: 2.1 time: 0.209185 Jun 15 10:37:53.122151 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 386/795] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:37:52 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/ips => generated 145 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:37:54.469271 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b96ac1b3-5dc6-4485-a72d-0d6eac55678e"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:37:54.470392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:37:54.477500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:54.478014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:54.479109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:37:54.479940 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:37:54.761398 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b32d4933-7d5c-48c7-8179-be743e1aa923 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296397 Jun 15 10:37:54.764774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 410/796] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:37:54 2022] POST /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:02.295233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:02.296207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:02.298397 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:02.304951 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:02.305400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:02.306160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:02.306593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:02.338681 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7df36822-65da-4739-9c88-fe372464ff62 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047668 Jun 15 10:38:02.339242 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 387/797] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:38:02 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:02.350886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:02.351499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:02.357741 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:02.358189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:02.358952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:02.359446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:02.387388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bbf74433-2308-4451-8e39-fefe3b4e5131 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/b96ac1b3-5dc6-4485-a72d-0d6eac55678e" status: 200 len: 194 microversion: 2.1 time: 0.041944 Jun 15 10:38:02.387950 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 411/798] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Jun 15 10:38:02 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/b96ac1b3-5dc6-4485-a72d-0d6eac55678e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:03.691353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f533441b-b712-4cb2-bc82-115e6e2aac47"}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:03.692466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:03.698954 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:03.699429 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:03.700184 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:03.700619 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:03.959154 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-fbc89e4f-4415-48af-9418-70a10a5f4b91 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "POST /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271592 Jun 15 10:38:03.959956 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 388/799] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:38:03 2022] POST /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:11.443831 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:11.444841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:11.451879 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:11.452387 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:11.453149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:11.453686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:11.457723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:11.485581 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7d3f4a28-cd38-428b-bcc1-27e6f5e55eb6 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045851 Jun 15 10:38:11.486835 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 412/800] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:38:11 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:11.641173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:11.641742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:11.648654 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:11.649034 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:11.650033 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:11.650492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:11.652941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:11.681742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9597493d-c60c-4eb2-a3fc-a0617769b24d tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/b96ac1b3-5dc6-4485-a72d-0d6eac55678e" status: 200 len: 194 microversion: 2.1 time: 0.044902 Jun 15 10:38:11.682314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 389/801] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Jun 15 10:38:11 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/b96ac1b3-5dc6-4485-a72d-0d6eac55678e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:11.691786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:11.692282 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:11.698302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:11.698752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:11.699535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:11.699971 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:11.778521 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lazy-loading 'services' on Instance uuid 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:38:11.854122 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-413b2f4a-a62f-4c15-aea8-6fd70f71e5e9 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/b96ac1b3-5dc6-4485-a72d-0d6eac55678e" status: 202 len: 0 microversion: 2.1 time: 0.162424 Jun 15 10:38:11.854122 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 413/802] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:38:11 2022] DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/b96ac1b3-5dc6-4485-a72d-0d6eac55678e => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:38:14.016022 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:14.016527 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:14.023328 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:14.023784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:14.024553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:14.025259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:14.057065 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-87cc4b0e-4129-4031-a01f-7e2e8badf11e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/f533441b-b712-4cb2-bc82-115e6e2aac47" status: 200 len: 194 microversion: 2.1 time: 0.044889 Jun 15 10:38:14.057944 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 390/803] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Jun 15 10:38:14 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/f533441b-b712-4cb2-bc82-115e6e2aac47 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:14.068140 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:14.068702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:14.075771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:14.076215 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:14.077168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:14.077598 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:14.159158 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lazy-loading 'services' on Instance uuid 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:38:14.248683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f82cbd7b-7349-4ab4-a444-cefc3a37162c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/f533441b-b712-4cb2-bc82-115e6e2aac47" status: 202 len: 0 microversion: 2.1 time: 0.184655 Jun 15 10:38:14.249277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 414/804] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:38:14 2022] DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments/f533441b-b712-4cb2-bc82-115e6e2aac47 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 10:38:15.422618 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:15.423743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:15.429965 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.430799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.431784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.432222 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.461952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-49708a0b-db98-496d-b3f1-70231060303c tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043999 Jun 15 10:38:15.462511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 391/805] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:38:15 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:38:15.588812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:15.591643 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:15.601906 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.602356 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.603159 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.603598 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.633883 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1939e171-ea7f-4c88-9ff9-2e078b12c80e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051185 Jun 15 10:38:15.634439 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 415/806] 10.222.0.49 () {58 vars in 1301 bytes} [Wed Jun 15 10:38:15 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 10:38:15.695904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:15.696400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:15.703534 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.704040 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.704845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.705282 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.734846 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:38:15.818195 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b31a4a37-014f-4a09-b300-f05bf5f13de8 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 204 len: 0 microversion: 2.1 time: 0.124368 Jun 15 10:38:15.818195 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 392/807] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:38:15 2022] DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:38:15.825945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:15.826843 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:15.838104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.843243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.844177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:15.844662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:15.982894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:15.991037 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cf60eec9-0c6e-4dbc-b049-448150a9d6a1 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1671 microversion: 2.1 time: 0.169408 Jun 15 10:38:15.991625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 416/808] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:15 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:17.009134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:17.009818 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:17.016269 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:17.016711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:17.018146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:17.018576 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:17.146259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:17.154500 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-aeb362bd-b43c-4427-8d76-067444d323db tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1671 microversion: 2.1 time: 0.149533 Jun 15 10:38:17.155185 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 393/809] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:17 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:18.172032 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:18.172821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:18.176686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=20 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:18.181156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:18.181602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:18.182369 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:18.182801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:18.325334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:18.333729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-00fc0a77-bc2f-4653-9cd6-5da72cf34c8b tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1671 microversion: 2.1 time: 0.165732 Jun 15 10:38:18.334291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 417/810] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:18 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:18.789016 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-7ed92d69-3bf6-40ec-a1a5-f7439b0db22d req-c0bd587f-b76f-46e1-843c-0d9f717bb56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0", "name": "network-vif-deleted", "tag": "d4223ab9-d65a-4c10-9746-fe9a557c6a3d"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:18.799219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-7ed92d69-3bf6-40ec-a1a5-f7439b0db22d req-c0bd587f-b76f-46e1-843c-0d9f717bb56f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:18.799656 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-7ed92d69-3bf6-40ec-a1a5-f7439b0db22d req-c0bd587f-b76f-46e1-843c-0d9f717bb56f service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:18.810935 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-7ed92d69-3bf6-40ec-a1a5-f7439b0db22d req-c0bd587f-b76f-46e1-843c-0d9f717bb56f service nova] Creating event network-vif-deleted:d4223ab9-d65a-4c10-9746-fe9a557c6a3d for instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 on hv-cinder-84349 Jun 15 10:38:18.816342 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-7ed92d69-3bf6-40ec-a1a5-f7439b0db22d req-c0bd587f-b76f-46e1-843c-0d9f717bb56f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 Jun 15 10:38:18.817132 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 394/811] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:19.352851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:19.353984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:19.363076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:19.363973 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:19.365468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:19.366090 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:19.415842 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:19.416754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:19.417412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lazy-loading 'fault' on Instance uuid 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:38:19.487113 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca22364db8147f2a14f3a0c77f545de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5320ba7f73d40cb9a6d16225d6660c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:19.494912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c0863a42-1615-4520-acb9-32a402d46d77 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 200 len: 1325 microversion: 2.1 time: 0.148223 Jun 15 10:38:19.495522 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 418/812] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:19 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 1325 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:20.512924 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:20.513615 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:20.520460 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:20.520904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:20.521745 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:20.522178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:20.536988 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] HTTP exception thrown: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Request method failure captured: Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 HTTP/1.1 Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbVKKZvMV3hnUlfZQOJhXBI0jDgMG-mCeh-VAlXAMdN-RFa5UcRfrinL3_52wlejoPT9-2PxzPgLyAuRyN2lJF65TlFClKGdCmHATrVaZmLtRHYm4GFrI7agSaIks2slULGAnxm7HaD8hIydGhGcKkxUQ3EJs09sNLUVlmceDlaklCg Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:20.538560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 9ca22364db8147f2a14f3a0c77f545de Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:20.540295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0'} Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:20.541409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:20.542976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:20.544722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Returning 404 to user: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:20.544722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b1e0b5df-b9b5-4e6a-b141-606fb264f803 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 404 len: 111 microversion: 2.1 time: 0.031956 Jun 15 10:38:20.544722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 395/813] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:20 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:20.548827 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-439f7fec-facb-41ff-9cee-7a5301dcf07e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '.version_select at 0x7feb3a8b7700>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:20.566063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-439f7fec-facb-41ff-9cee-7a5301dcf07e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22362698" status: 202 len: 0 microversion: 2.1 time: 0.021060 Jun 15 10:38:20.566607 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 419/814] 10.222.0.49 () {58 vars in 1214 bytes} [Wed Jun 15 10:38:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22362698 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:38:23.639634 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:23.640854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:23.648819 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:23.649159 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:23.650314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:23.650814 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:23.681575 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d19e5263-281e-45e1-b210-890dc91edfa2 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047001 Jun 15 10:38:23.682188 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 396/815] 10.222.0.49 () {60 vars in 1342 bytes} [Wed Jun 15 10:38:23 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:23.740905 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:23.741402 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:23.748482 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:23.748924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:23.749673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:23.750105 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:23.774206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:38:23.856558 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cdb4afcc-9bee-45f6-9847-859fc88aec01 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 204 len: 0 microversion: 2.20 time: 0.119521 Jun 15 10:38:23.857163 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 420/816] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jun 15 10:38:23 2022] DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:38:23.869779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:23.869779 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:23.872825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:23.873283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:23.874030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:23.874465 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:24.006303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:24.014198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:24.015707 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:24.017388 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3f85de91-1fef-4d29-9cd5-33559f908d11 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.154761 Jun 15 10:38:24.017941 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 397/817] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:38:23 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:38:24.478107 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:24.478694 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:24.484864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:24.485319 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:24.486264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:24.486716 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:24.502206 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] HTTP exception thrown: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Request method failure captured: Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 HTTP/1.1 Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbVKKZvMV3hnUlfZQOJhXBI0jDgMG-mCeh-VAlXAMdN-RFa5UcRfrinL3_52wlejoPT9-2PxzPgLyAuRyN2lJF65TlFClKGdCmHATrVaZmLtRHYm4GFrI7agSaIks2slULGAnxm7HaD8hIydGhGcKkxUQ3EJs09sNLUVlmceDlaklCg Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:24.504036 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 9ca22364db8147f2a14f3a0c77f545de Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.505420 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0'} Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:24.506147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.507785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.509443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Returning 404 to user: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:24.509443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9cf77d70-0df6-4d88-960b-84cc18180390 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 404 len: 111 microversion: 2.1 time: 0.031903 Jun 15 10:38:24.509443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 421/818] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:38:24 2022] DELETE /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:24.514281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:24.514909 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:24.521674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:24.522122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:24.522876 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:24.523344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:24.538636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] HTTP exception thrown: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Request method failure captured: Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 HTTP/1.1 Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbVKKZvMV3hnUlfZQOJhXBI0jDgMG-mCeh-VAlXAMdN-RFa5UcRfrinL3_52wlejoPT9-2PxzPgLyAuRyN2lJF65TlFClKGdCmHATrVaZmLtRHYm4GFrI7agSaIks2slULGAnxm7HaD8hIydGhGcKkxUQ3EJs09sNLUVlmceDlaklCg Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:24.540309 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 9ca22364db8147f2a14f3a0c77f545de Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.542012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0'} Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:24.543281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. Jun 15 10:38:24.544726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:24.546172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Returning 404 to user: Instance 8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:24.546172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-721b57f0-5449-4a05-aafa-9805d71565a0 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0" status: 404 len: 111 microversion: 2.1 time: 0.031363 Jun 15 10:38:24.546172 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 398/819] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:24 2022] GET /compute/v2.1/servers/8d87a8b6-c0cf-41b2-a230-0dd3cd754eb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:25.035477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:25.036084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:25.042521 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:25.042967 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:25.043833 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:25.044326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:25.175617 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:25.184074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:25.185664 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:25.186847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d067194c-3f43-4156-9a62-8ca374c8b8c7 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1722 microversion: 2.20 time: 0.155294 Jun 15 10:38:25.187433 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 422/820] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:38:25 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:38:25.682670 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:25.683210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:25.689829 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:25.690282 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:25.691048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:25.691583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:25.706184 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] HTTP exception thrown: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Request method failure captured: Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 HTTP/1.1 Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbVKKZvMV3hnUlfZQOJhXBI0jDgMG-mCeh-VAlXAMdN-RFa5UcRfrinL3_52wlejoPT9-2PxzPgLyAuRyN2lJF65TlFClKGdCmHATrVaZmLtRHYm4GFrI7agSaIks2slULGAnxm7HaD8hIydGhGcKkxUQ3EJs09sNLUVlmceDlaklCg Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:25.707768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 9ca22364db8147f2a14f3a0c77f545de Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.709400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '3b8e51d7-b834-4fe4-8cea-02ce37c5cce2'} Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:25.710303 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.711889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.713504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Returning 404 to user: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:25.713504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f8df4b6b-b909-40de-9fbd-673e4ef5c27e tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 404 len: 111 microversion: 2.1 time: 0.030484 Jun 15 10:38:25.713504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 399/821] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:38:25 2022] DELETE /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:25.723007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:25.728317 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] [instance: 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:25.740787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:25.741516 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:25.742602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:25.743336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:25.759562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] HTTP exception thrown: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Request method failure captured: Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 HTTP/1.1 Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbVKKZvMV3hnUlfZQOJhXBI0jDgMG-mCeh-VAlXAMdN-RFa5UcRfrinL3_52wlejoPT9-2PxzPgLyAuRyN2lJF65TlFClKGdCmHATrVaZmLtRHYm4GFrI7agSaIks2slULGAnxm7HaD8hIydGhGcKkxUQ3EJs09sNLUVlmceDlaklCg Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:25.761623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5320ba7f73d40cb9a6d16225d6660c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: d5320ba7f73d40cb9a6d16225d6660c7 Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126031821 Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 9ca22364db8147f2a14f3a0c77f545de Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeTestJSON-1126031821-project Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.763272 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '3b8e51d7-b834-4fe4-8cea-02ce37c5cce2'} Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:25.764326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. Jun 15 10:38:25.765981 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:25.768316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] Returning 404 to user: Instance 3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:25.769189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-619bdc4c-d591-42db-8ea5-67b801a41629 tempest-AttachVolumeTestJSON-1126031821 tempest-AttachVolumeTestJSON-1126031821-project] 10.222.0.49 "GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2" status: 404 len: 111 microversion: 2.1 time: 0.051162 Jun 15 10:38:25.769745 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 423/822] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:25 2022] GET /compute/v2.1/servers/3b8e51d7-b834-4fe4-8cea-02ce37c5cce2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:38:26.211587 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:26.214903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:26.223411 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:26.224632 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:26.225560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:26.226097 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:26.328706 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:26.336928 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:26.338510 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cca7cb5e7620446ebae91b1fe12bbd24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dc28af73e82414d8f709e447286a962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:26.339785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a31b1295-b046-4c7f-849b-0d3a903c378f tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 200 len: 1655 microversion: 2.20 time: 0.135514 Jun 15 10:38:26.340705 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 400/823] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:38:26 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 1655 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 10:38:26.437090 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-80110740-3a87-4c88-91cc-d78264c8b2c0 req-dd76bf09-1cb3-4b12-9193-65e4a8bfdb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be43f1ad-ad30-49ed-aca4-d70e0dbf1291", "name": "network-vif-deleted", "tag": "5edece31-59c1-43eb-bba5-3ede89417a40"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:26.446250 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-80110740-3a87-4c88-91cc-d78264c8b2c0 req-dd76bf09-1cb3-4b12-9193-65e4a8bfdb69 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:26.446872 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-80110740-3a87-4c88-91cc-d78264c8b2c0 req-dd76bf09-1cb3-4b12-9193-65e4a8bfdb69 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:26.463715 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-80110740-3a87-4c88-91cc-d78264c8b2c0 req-dd76bf09-1cb3-4b12-9193-65e4a8bfdb69 service nova] Creating event network-vif-deleted:5edece31-59c1-43eb-bba5-3ede89417a40 for instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 on hv-cinder-84349 Jun 15 10:38:26.469620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-80110740-3a87-4c88-91cc-d78264c8b2c0 req-dd76bf09-1cb3-4b12-9193-65e4a8bfdb69 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Jun 15 10:38:26.471535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 424/824] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:27.358593 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:27.360722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:27.386066 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:27.388460 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:27.389693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:27.392474 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:27.419492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] HTTP exception thrown: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Request method failure captured: Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 HTTP/1.1 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUI_QcTjTMWGH6XgFADqiocFZRqC_uJpoTfBgEzT0iNltPrRWI9cSUNkQt3Gesw2KFm9qUMPmsTIwkh61yNMwgjSWvCiJCLo7NQzg72ggcRWoEpBqkazDZadI38HyUYZv6leolPFZH9zt_lAkxqeh083vSkreehnOSS3JEm-ruzoHo Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:27.422950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5dc28af73e82414d8f709e447286a962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5dc28af73e82414d8f709e447286a962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: cca7cb5e7620446ebae91b1fe12bbd24 Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:27.424398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': 'be43f1ad-ad30-49ed-aca4-d70e0dbf1291'} Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:27.425134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:27.426335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:27.430185 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Returning 404 to user: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:27.431734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-38cd3378-0d76-41db-b4b5-78c3c74ec4dd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 404 len: 111 microversion: 2.20 time: 0.077506 Jun 15 10:38:27.432554 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 401/825] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:38:27 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:38:27.443964 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3ac357dd-2f0a-485e-ad3f-dc3274653f10 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '.version_select at 0x7feb3a8b7160>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:27.483559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3ac357dd-2f0a-485e-ad3f-dc3274653f10 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486971372" status: 204 len: 0 microversion: 2.20 time: 0.046151 Jun 15 10:38:27.484636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 425/826] 10.222.0.49 () {60 vars in 1258 bytes} [Wed Jun 15 10:38:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486971372 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 10:38:29.865269 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:29.865746 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:29.874346 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:29.874860 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:29.878568 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:29.879063 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:29.897279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] HTTP exception thrown: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Request method failure captured: Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 HTTP/1.1 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbUI_QcTjTMWGH6XgFADqiocFZRqC_uJpoTfBgEzT0iNltPrRWI9cSUNkQt3Gesw2KFm9qUMPmsTIwkh61yNMwgjSWvCiJCLo7NQzg72ggcRWoEpBqkazDZadI38HyUYZv6leolPFZH9zt_lAkxqeh083vSkreehnOSS3JEm-ruzoHo Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:29.898864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5dc28af73e82414d8f709e447286a962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5dc28af73e82414d8f709e447286a962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: cca7cb5e7620446ebae91b1fe12bbd24 Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.900725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': 'be43f1ad-ad30-49ed-aca4-d70e0dbf1291'} Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:29.901562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.902867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.904145 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Returning 404 to user: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:29.904145 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-52c526a6-aa19-4c66-9a1e-f852fa7cc59c tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 404 len: 111 microversion: 2.20 time: 0.039124 Jun 15 10:38:29.904145 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 402/827] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jun 15 10:38:29 2022] DELETE /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:38:29.909776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:29.910510 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: be43f1ad-ad30-49ed-aca4-d70e0dbf1291] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:29.920006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:29.920505 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:29.921265 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:29.921644 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:29.940145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] HTTP exception thrown: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Request method failure captured: Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 HTTP/1.1 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUI_QcTjTMWGH6XgFADqiocFZRqC_uJpoTfBgEzT0iNltPrRWI9cSUNkQt3Gesw2KFm9qUMPmsTIwkh61yNMwgjSWvCiJCLo7NQzg72ggcRWoEpBqkazDZadI38HyUYZv6leolPFZH9zt_lAkxqeh083vSkreehnOSS3JEm-ruzoHo Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:29.941822 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5dc28af73e82414d8f709e447286a962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5dc28af73e82414d8f709e447286a962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cca7cb5e7620446ebae91b1fe12bbd24 Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.943591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'be43f1ad-ad30-49ed-aca4-d70e0dbf1291'} Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:29.947555 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. Jun 15 10:38:29.949028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:29.950587 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Returning 404 to user: Instance be43f1ad-ad30-49ed-aca4-d70e0dbf1291 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:29.950587 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0957283d-abc6-4523-9150-4d6f7a07a462 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291" status: 404 len: 111 microversion: 2.20 time: 0.038293 Jun 15 10:38:29.950587 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 426/828] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:38:29 2022] GET /compute/v2.1/servers/be43f1ad-ad30-49ed-aca4-d70e0dbf1291 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:38:31.149185 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:31.150040 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:31.158377 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:31.159037 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:31.159918 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:31.160349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:31.179761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] HTTP exception thrown: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Request method failure captured: Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f HTTP/1.1 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUI_QcTjTMWGH6XgFADqiocFZRqC_uJpoTfBgEzT0iNltPrRWI9cSUNkQt3Gesw2KFm9qUMPmsTIwkh61yNMwgjSWvCiJCLo7NQzg72ggcRWoEpBqkazDZadI38HyUYZv6leolPFZH9zt_lAkxqeh083vSkreehnOSS3JEm-ruzoHo Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:31.181392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5dc28af73e82414d8f709e447286a962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5dc28af73e82414d8f709e447286a962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cca7cb5e7620446ebae91b1fe12bbd24 Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.183001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '16e37acd-69b1-4758-8ab5-07ec67e9ae2f'} Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.183930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.185346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.186626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Returning 404 to user: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.186626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-992a1cd6-5a65-4c3f-838d-c5eeeac8bf64 tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 404 len: 111 microversion: 2.20 time: 0.038013 Jun 15 10:38:31.186626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 427/829] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Jun 15 10:38:31 2022] DELETE /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:38:31.191663 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:31.192300 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] [instance: 16e37acd-69b1-4758-8ab5-07ec67e9ae2f] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:31.198319 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:31.198759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:31.199854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:31.200091 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:31.214484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] HTTP exception thrown: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Request method failure captured: Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f HTTP/1.1 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbUI_QcTjTMWGH6XgFADqiocFZRqC_uJpoTfBgEzT0iNltPrRWI9cSUNkQt3Gesw2KFm9qUMPmsTIwkh61yNMwgjSWvCiJCLo7NQzg72ggcRWoEpBqkazDZadI38HyUYZv6leolPFZH9zt_lAkxqeh083vSkreehnOSS3JEm-ruzoHo Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:31.216266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5dc28af73e82414d8f709e447286a962"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5dc28af73e82414d8f709e447286a962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5dc28af73e82414d8f709e447286a962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 5dc28af73e82414d8f709e447286a962 Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353312139 Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cca7cb5e7620446ebae91b1fe12bbd24 Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353312139-project Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.217912 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '16e37acd-69b1-4758-8ab5-07ec67e9ae2f'} Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.219005 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. Jun 15 10:38:31.220855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.222095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] Returning 404 to user: Instance 16e37acd-69b1-4758-8ab5-07ec67e9ae2f could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.222095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-68582afe-d8a2-4d7a-8832-24acdab9f2fd tempest-AttachVolumeShelveTestJSON-353312139 tempest-AttachVolumeShelveTestJSON-353312139-project] 10.222.0.49 "GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f" status: 404 len: 111 microversion: 2.20 time: 0.029763 Jun 15 10:38:31.222095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 428/830] 10.222.0.49 () {60 vars in 1276 bytes} [Wed Jun 15 10:38:31 2022] GET /compute/v2.1/servers/16e37acd-69b1-4758-8ab5-07ec67e9ae2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:38:31.240306 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-728b27bf-7c57-4994-b31f-768cf8eade2a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Action: 'create', calling method: .version_select at 0x7feb3a9e7d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1597466046", "metadata": {"Type": "work"}}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-728b27bf-7c57-4994-b31f-768cf8eade2a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Request method failure captured: Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 122 Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqban4HPTvK2S2RDiS-zV-BfL956uG9ruiFCPFCrbKuX9PJGPc4rJNZGt_GSv3OD8prLBt3TiRaRzvzuo6xTsR7I-p0V4PgOCODK-ERO-J4up1lefiEKGqwVR-A5ubqqI60R7gn3UoGzumlNb6wA5TEpvbVhrRhyB0WXKHysekCpD1Go Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:31.269101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: cb88d15829b941db99ed9071040eec1a Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1597466046", "metadata": {"Type": "work"}}} Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: Jun 15 10:38:31.270797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1597466046', 'metadata': {'Type': 'work'}}}} Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise error Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.271766 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 10:38:31.273080 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 10:38:31.274233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 10:38:31.274233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.274233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-728b27bf-7c57-4994-b31f-768cf8eade2a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.274233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-728b27bf-7c57-4994-b31f-768cf8eade2a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.158669 Jun 15 10:38:31.274233 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 403/831] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jun 15 10:38:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:38:31.280553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b07dc404-65ae-46d4-9aac-de04588e76fd tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Action: 'create', calling method: .version_select at 0x7feb3aaf3ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1360609809", "metadata": {"Type": "work"}}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b07dc404-65ae-46d4-9aac-de04588e76fd tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Request method failure captured: Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 120 Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqban4HPTvK2S2RDiS-zV-BfL956uG9ruiFCPFCrbKuX9PJGPc4rJNZGt_GSv3OD8prLBt3TiRaRzvzuo6xTsR7I-p0V4PgOCODK-ERO-J4up1lefiEKGqwVR-A5ubqqI60R7gn3UoGzumlNb6wA5TEpvbVhrRhyB0WXKHysekCpD1Go Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:31.284326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cb88d15829b941db99ed9071040eec1a Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1360609809", "metadata": {"Type": "work"}}} Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:38:31.285677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1360609809', 'metadata': {'Type': 'work'}}}} Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise error Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi '0' Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.286475 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 10:38:31.287946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 10:38:31.289048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 10:38:31.289048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.289048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b07dc404-65ae-46d4-9aac-de04588e76fd tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.289048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b07dc404-65ae-46d4-9aac-de04588e76fd tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009077 Jun 15 10:38:31.289048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 429/832] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jun 15 10:38:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 10:38:31.296598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a072613c-1b20-4040-8483-c745fc14ef7c tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Action: 'create', calling method: .version_select at 0x7feb3aa6c940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-9408205", "metadata": {"Type": "work"}}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a072613c-1b20-4040-8483-c745fc14ef7c tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Request method failure captured: Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 116 Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqban4HPTvK2S2RDiS-zV-BfL956uG9ruiFCPFCrbKuX9PJGPc4rJNZGt_GSv3OD8prLBt3TiRaRzvzuo6xTsR7I-p0V4PgOCODK-ERO-J4up1lefiEKGqwVR-A5ubqqI60R7gn3UoGzumlNb6wA5TEpvbVhrRhyB0WXKHysekCpD1Go Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:31.300675 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: cb88d15829b941db99ed9071040eec1a Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-9408205", "metadata": {"Type": "work"}}} Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: Jun 15 10:38:31.302190 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-9408205', 'metadata': {'Type': 'work'}}}} Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise error Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi '' Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.303592 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 10:38:31.305173 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 10:38:31.306720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 10:38:31.306720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.306720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a072613c-1b20-4040-8483-c745fc14ef7c tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.306720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a072613c-1b20-4040-8483-c745fc14ef7c tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009824 Jun 15 10:38:31.306720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 404/833] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Jun 15 10:38:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 10:38:31.312060 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ea48519f-ea92-411f-aa21-be8f059b27ee tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Calling method '.version_select at 0x7feb3aa83040>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:31.342213 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-ea48519f-ea92-411f-aa21-be8f059b27ee tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] HTTP exception thrown: Volume tempest-invalid-192441131 could not be found. Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ea48519f-ea92-411f-aa21-be8f059b27ee tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Request method failure captured: Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-192441131 HTTP/1.1 Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqban4HPTvK2S2RDiS-zV-BfL956uG9ruiFCPFCrbKuX9PJGPc4rJNZGt_GSv3OD8prLBt3TiRaRzvzuo6xTsR7I-p0V4PgOCODK-ERO-J4up1lefiEKGqwVR-A5ubqqI60R7gn3UoGzumlNb6wA5TEpvbVhrRhyB0WXKHysekCpD1Go Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:31.344197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cb88d15829b941db99ed9071040eec1a Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Volume tempest-invalid-192441131 could not be found. Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'tempest-invalid-192441131'} Jun 15 10:38:31.346336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-192441131 could not be found. (HTTP 404) (Request-ID: req-659b2ec3-cf3c-480a-8803-bd1e377360df) Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.348001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:38:31.350731 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-192441131 could not be found. Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:31.352484 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-192441131 could not be found. Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-192441131 could not be found. Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ea48519f-ea92-411f-aa21-be8f059b27ee tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Returning 404 to user: Volume tempest-invalid-192441131 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ea48519f-ea92-411f-aa21-be8f059b27ee tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-192441131" status: 404 len: 98 microversion: 2.1 time: 0.037995 Jun 15 10:38:31.354323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 430/834] 10.222.0.49 () {58 vars in 1214 bytes} [Wed Jun 15 10:38:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-192441131 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 10:38:31.359754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3b44ac60-0f64-47b6-a265-90cab652ac53 tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006557 Jun 15 10:38:31.360535 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 405/835] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Jun 15 10:38:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 10:38:31.369744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-bb56262e-4ed2-485f-85f6-c640fdf6e170 tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004372 Jun 15 10:38:31.370238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 431/836] 10.222.0.49 () {58 vars in 1136 bytes} [Wed Jun 15 10:38:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 10:38:31.379584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4f0f86c9-9e13-4ab6-bf43-31f9a3f1a72a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Calling method '.version_select at 0x7feb3a9d40d0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:31.414440 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-4f0f86c9-9e13-4ab6-bf43-31f9a3f1a72a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] HTTP exception thrown: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4f0f86c9-9e13-4ab6-bf43-31f9a3f1a72a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Request method failure captured: Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/os-volumes/122d9f2d-522c-452a-9291-caf5b2ef4ed4 HTTP/1.1 Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqban4HPTvK2S2RDiS-zV-BfL956uG9ruiFCPFCrbKuX9PJGPc4rJNZGt_GSv3OD8prLBt3TiRaRzvzuo6xTsR7I-p0V4PgOCODK-ERO-J4up1lefiEKGqwVR-A5ubqqI60R7gn3UoGzumlNb6wA5TEpvbVhrRhyB0WXKHysekCpD1Go Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:38:31.417734 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: cb88d15829b941db99ed9071040eec1a Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '122d9f2d-522c-452a-9291-caf5b2ef4ed4'} Jun 15 10:38:31.419356 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. (HTTP 404) (Request-ID: req-1232a83e-41c9-4d21-bfdb-8be38800e023) Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.420354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 10:38:31.421949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 10:38:31.423589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4f0f86c9-9e13-4ab6-bf43-31f9a3f1a72a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Returning 404 to user: Volume 122d9f2d-522c-452a-9291-caf5b2ef4ed4 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.425057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4f0f86c9-9e13-4ab6-bf43-31f9a3f1a72a tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/122d9f2d-522c-452a-9291-caf5b2ef4ed4" status: 404 len: 109 microversion: 2.1 time: 0.043559 Jun 15 10:38:31.429492 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3e6d9dc7-60b4-422b-abe9-271efc7853df tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Calling method '.version_select at 0x7feb3aa83310>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:31.435232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 406/837] 10.222.0.49 () {58 vars in 1247 bytes} [Wed Jun 15 10:38:31 2022] DELETE /compute/v2.1/os-volumes/122d9f2d-522c-452a-9291-caf5b2ef4ed4 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:31.461074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-3e6d9dc7-60b4-422b-abe9-271efc7853df tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] HTTP exception thrown: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3e6d9dc7-60b4-422b-abe9-271efc7853df tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Request method failure captured: Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/os-volumes/9b57ff9e-3c39-4796-9013-891eb3512046 HTTP/1.1 Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqban4HPTvK2S2RDiS-zV-BfL956uG9ruiFCPFCrbKuX9PJGPc4rJNZGt_GSv3OD8prLBt3TiRaRzvzuo6xTsR7I-p0V4PgOCODK-ERO-J4up1lefiEKGqwVR-A5ubqqI60R7gn3UoGzumlNb6wA5TEpvbVhrRhyB0WXKHysekCpD1Go Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:38:31.463010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8317ecae5bc54a03ac059871ade2e3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 8317ecae5bc54a03ac059871ade2e3b5 Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesNegativeTest-244686586 Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: cb88d15829b941db99ed9071040eec1a Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesNegativeTest-244686586-project Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '9b57ff9e-3c39-4796-9013-891eb3512046'} Jun 15 10:38:31.464313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. (HTTP 404) (Request-ID: req-a66804f8-3367-4ee5-9828-dd0dc8a3d910) Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.465099 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 10:38:31.466266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 10:38:31.468808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3e6d9dc7-60b4-422b-abe9-271efc7853df tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] Returning 404 to user: Volume 9b57ff9e-3c39-4796-9013-891eb3512046 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3e6d9dc7-60b4-422b-abe9-271efc7853df tempest-VolumesNegativeTest-244686586 tempest-VolumesNegativeTest-244686586-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9b57ff9e-3c39-4796-9013-891eb3512046" status: 404 len: 109 microversion: 2.1 time: 0.038686 Jun 15 10:38:31.472473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 432/838] 10.222.0.49 () {58 vars in 1244 bytes} [Wed Jun 15 10:38:31 2022] GET /compute/v2.1/os-volumes/9b57ff9e-3c39-4796-9013-891eb3512046 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:52.680741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:52.682472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:53.091560 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f3d48e85-fb58-47bc-9501-d8067a65a42b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Action: 'create', calling method: .version_select at 0x7feb3aae4af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2010066906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBGJFL52OqjGLaGBEUZOY3YQrif3htYz5tXYf0exFXlTHoWzYbEZr2h3jcraQUOP0nbb6IqDaPam5R5uXwUn5hNdCj/hYUMEI4clhBDtUWs/2/z0dwH1QWed67rsIu23Q=="}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:53.107334 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-f3d48e85-fb58-47bc-9501-d8067a65a42b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:38:53.113001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-f3d48e85-fb58-47bc-9501-d8067a65a42b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for user 61bc9ad2c9444fc297eb4b5902a67b98 and project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:38:53.142182 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f3d48e85-fb58-47bc-9501-d8067a65a42b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.462721 Jun 15 10:38:53.143056 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 407/839] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:38:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:38:55.600365 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:55.601189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:55.607016 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-750217028", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:55.668473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] validate_networks() for None {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:38:56.079288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:38:56.080014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:38:56.080695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:38:56.081399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:38:56.081979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:38:56.100769 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:56.101270 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:56.102246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:56.102677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:56.131114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Getting quotas for project aab8980da8444a9789dd0c0b4b88aeac. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:38:56.137886 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Getting quotas for user 8a8ea7b3022e44f48179326c25646c38 and project aab8980da8444a9789dd0c0b4b88aeac. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:38:56.152382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:38:56.154952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:38:56.220778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-027fb036-88c0-45c9-9639-99b5c1da03a3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621976 Jun 15 10:38:56.221678 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 433/840] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:38:56.233979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a40c9d6b-94ae-43c7-a8c6-c2cfa6f5db12 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:56.235428 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a40c9d6b-94ae-43c7-a8c6-c2cfa6f5db12 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:56.333791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a40c9d6b-94ae-43c7-a8c6-c2cfa6f5db12 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:56.341644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a40c9d6b-94ae-43c7-a8c6-c2cfa6f5db12 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1214 microversion: 2.1 time: 0.111330 Jun 15 10:38:56.342558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 408/841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:56 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:57.361824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:57.363541 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:57.372686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:57.373704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:57.374574 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:57.375778 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:57.456813 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:57.475296 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9291aa3a-c694-4e44-97cf-f1c9479c7b22 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1266 microversion: 2.1 time: 0.118626 Jun 15 10:38:57.477007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 434/842] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:57 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:57.742191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-227381275", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "networks": [{"uuid": "7dd91b3b-0ef5-4a72-9997-b791d1b8253c"}]}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:38:57.850720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] validate_networks() for [('7dd91b3b-0ef5-4a72-9997-b791d1b8253c', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:38:58.493901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:58.495485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:58.502625 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:58.503487 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:58.504419 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:58.505360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:58.615414 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:58.624336 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-64ab4440-1ac0-4c03-b72f-3f46acbd924f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1272 microversion: 2.1 time: 0.135037 Jun 15 10:38:58.627686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 435/843] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:58 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:38:58.752615 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:38:58.753135 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:38:58.753601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:38:58.753903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:38:58.754354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:38:58.764906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:58.765361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:58.766708 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:58.767170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:58.797273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Getting quotas for project 3efa3522561147ac8eff67781403423e. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:38:58.805800 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Getting quotas for user 07276de63b65403585d0d7c576447f96 and project 3efa3522561147ac8eff67781403423e. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:38:58.823123 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:38:58.825549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:38:58.878857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c5791ba5-7a47-4cab-8537-2592eb2d69ce tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140371 Jun 15 10:38:58.879589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 409/844] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:38:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:38:58.890238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aa85827d-6c09-4d91-873e-8a7bee3e0936 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:58.891737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aa85827d-6c09-4d91-873e-8a7bee3e0936 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:58.962824 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aa85827d-6c09-4d91-873e-8a7bee3e0936 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:58.972504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aa85827d-6c09-4d91-873e-8a7bee3e0936 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1213 microversion: 2.1 time: 0.086052 Jun 15 10:38:58.973200 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 436/845] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:58 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:38:59.643728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:59.644519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:38:59.681919 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:59.682903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:59.684686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:38:59.685137 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:38:59.955458 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:38:59.967436 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-317dccdd-8c52-488d-a19d-deb500f5361d tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.327718 Jun 15 10:38:59.968224 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 410/846] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:59 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:38:59.992926 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:38:59.993877 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:00.023071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:00.023603 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:00.027676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:00.028165 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:00.139364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:00.149454 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6c8d7e9b-de91-4a66-940a-8f564e4a27a7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1265 microversion: 2.1 time: 0.163482 Jun 15 10:39:00.150751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 437/847] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:38:59 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:00.258486 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-22f511ef-3e4a-4559-bc3b-37cfc6f3a3e9 req-dff814c0-7875-4c54-8435-f77bbef64fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e9a03b4-28e3-4086-8328-99534144d396", "tag": "e0acd26a-d36d-43cf-8141-4a172d82a96b"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:00.293266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-22f511ef-3e4a-4559-bc3b-37cfc6f3a3e9 req-dff814c0-7875-4c54-8435-f77bbef64fba service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:00.295409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-22f511ef-3e4a-4559-bc3b-37cfc6f3a3e9 req-dff814c0-7875-4c54-8435-f77bbef64fba service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:00.342316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-22f511ef-3e4a-4559-bc3b-37cfc6f3a3e9 req-dff814c0-7875-4c54-8435-f77bbef64fba service nova] Creating event network-changed:e0acd26a-d36d-43cf-8141-4a172d82a96b for instance 1e9a03b4-28e3-4086-8328-99534144d396 on hv-cinder-84349 Jun 15 10:39:00.349976 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-22f511ef-3e4a-4559-bc3b-37cfc6f3a3e9 req-dff814c0-7875-4c54-8435-f77bbef64fba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096176 Jun 15 10:39:00.351722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 411/848] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:00.985000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:00.986077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:00.992685 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:00.993132 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:00.993901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:00.994445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:01.158450 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:01.175774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dd6dc5e3-0a39-4de4-90fe-282d5eced00f tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.194579 Jun 15 10:39:01.176640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:01.177568 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:01.179752 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 438/849] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:00 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:01.187346 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:01.191824 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:01.194644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:01.196127 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:01.302297 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:01.319382 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ca1a2ebf-d929-4ff5-931f-ce7e02634209 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1271 microversion: 2.1 time: 0.152807 Jun 15 10:39:01.329400 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 412/850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:01 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:02.196540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:02.197156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:02.203816 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:02.204267 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:02.205042 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:02.205478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:02.336536 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:02.337336 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:02.345285 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:02.346542 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:02.350334 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:02.353143 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:02.373511 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:02.382786 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d79ec784-13c4-4265-952c-663837958c02 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.190051 Jun 15 10:39:02.389562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 439/851] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:02 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:03.011476 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:03.020062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b4aeb863-8424-4f07-80f3-d19293b39724 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.687294 Jun 15 10:39:03.020731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 413/852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:02 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:03.399858 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:03.400463 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:03.408203 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:03.408901 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:03.409863 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:03.410457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:03.558954 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:03.575613 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-323ee751-9e72-4650-9d24-03719043235c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.179219 Jun 15 10:39:03.576346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 440/853] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:03 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:03.598515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-ffdb6a8f-7c22-464b-b200-c2cd64be295a req-c32383c6-229d-4fb6-94fc-de07b3419b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e775b471-43e7-42ee-b07a-50dc0d59e089", "tag": "8a090001-2a4e-434f-9f38-4a75764a65e9"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:03.615158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-ffdb6a8f-7c22-464b-b200-c2cd64be295a req-c32383c6-229d-4fb6-94fc-de07b3419b1a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:03.615642 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-ffdb6a8f-7c22-464b-b200-c2cd64be295a req-c32383c6-229d-4fb6-94fc-de07b3419b1a service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:03.634644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-ffdb6a8f-7c22-464b-b200-c2cd64be295a req-c32383c6-229d-4fb6-94fc-de07b3419b1a service nova] Creating event network-changed:8a090001-2a4e-434f-9f38-4a75764a65e9 for instance e775b471-43e7-42ee-b07a-50dc0d59e089 on hv-cinder-84349 Jun 15 10:39:03.639438 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-ffdb6a8f-7c22-464b-b200-c2cd64be295a req-c32383c6-229d-4fb6-94fc-de07b3419b1a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050849 Jun 15 10:39:03.640392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 414/854] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:04.038117 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:04.038735 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:04.045318 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:04.047061 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:04.048045 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:04.048496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:04.276545 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:04.285682 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f53e22d0-efb2-4bbd-8b2c-bc7cb2ad2074 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.251750 Jun 15 10:39:04.292765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 441/855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:04 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:04.593856 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:04.602775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:04.602775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:04.602775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:04.602775 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:04.603767 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:04.764759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:04.773583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cd34bdb4-cf6a-4f9b-af4b-3421ccef418b tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.184026 Jun 15 10:39:04.783465 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 415/856] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:04 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:05.303573 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:05.304183 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:05.310676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:05.311147 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:05.311921 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:05.312390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:05.453199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:05.460675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-98fb8618-1c95-4010-996f-f9a481861084 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.160952 Jun 15 10:39:05.461238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 442/857] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:05 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:05.790482 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:05.791199 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:05.798497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:05.798969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:05.799752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:05.800183 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:05.927603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:05.934916 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e76cf164-48e4-41ce-8059-9dbf91d6f8d3 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.148308 Jun 15 10:39:05.935648 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 416/858] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:05 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:06.288110 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-483407766", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "networks": [{"uuid": "38c3248b-0ee1-440d-9b31-0c1018fc7378"}]}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:06.294660 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:06.337712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] validate_networks() for [('38c3248b-0ee1-440d-9b31-0c1018fc7378', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:39:06.477637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:06.478240 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:06.484231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:06.484669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:06.485413 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:06.485840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:06.623955 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:06.631973 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-775425af-0939-43bc-bb0f-9aff897129b2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.158100 Jun 15 10:39:06.632533 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 417/859] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:06 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:06.686145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:39:06.686614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:39:06.687655 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:39:06.688067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:39:06.688500 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:39:06.697152 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:06.697594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:06.698385 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:06.698813 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:06.715976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Getting quotas for project 129b7faaaf264434baf88ffe0fe9bb25. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:39:06.719763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Getting quotas for user 46fc1f62b79541e7a550731ee4728637 and project 129b7faaaf264434baf88ffe0fe9bb25. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:39:06.730408 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:39:06.732524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:39:06.778222 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d199a343-ca82-4176-b3e7-aaeddc2042e6 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493982 Jun 15 10:39:06.778868 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 443/860] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:39:06.792692 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-959e878d-daa5-4619-86a0-48812d103094 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:06.793838 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-959e878d-daa5-4619-86a0-48812d103094 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:06.855697 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-959e878d-daa5-4619-86a0-48812d103094 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:06.862327 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-959e878d-daa5-4619-86a0-48812d103094 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1218 microversion: 2.1 time: 0.077390 Jun 15 10:39:06.863039 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 418/861] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:06 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:06.951578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:06.952486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:06.962323 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:06.962499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:06.963501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:06.963860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:07.109965 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:07.119889 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-04592fe0-7787-4065-ad1c-c434b1d3a4b2 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.172148 Jun 15 10:39:07.121015 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 444/862] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:06 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:07.167429 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-f0b21c6d-1018-4257-aa50-d69dc8c663a8 req-d2ca5f9a-115b-494a-88a2-4020c949c661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9a03b4-28e3-4086-8328-99534144d396", "name": "network-vif-plugged", "status": "completed", "tag": "e0acd26a-d36d-43cf-8141-4a172d82a96b"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:07.176391 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-f0b21c6d-1018-4257-aa50-d69dc8c663a8 req-d2ca5f9a-115b-494a-88a2-4020c949c661 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:07.176845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-f0b21c6d-1018-4257-aa50-d69dc8c663a8 req-d2ca5f9a-115b-494a-88a2-4020c949c661 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:07.188473 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-f0b21c6d-1018-4257-aa50-d69dc8c663a8 req-d2ca5f9a-115b-494a-88a2-4020c949c661 service nova] Creating event network-vif-plugged:e0acd26a-d36d-43cf-8141-4a172d82a96b for instance 1e9a03b4-28e3-4086-8328-99534144d396 on hv-cinder-84349 Jun 15 10:39:07.194293 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-f0b21c6d-1018-4257-aa50-d69dc8c663a8 req-d2ca5f9a-115b-494a-88a2-4020c949c661 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Jun 15 10:39:07.196017 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 419/863] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:07.649533 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:07.650291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:07.657114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:07.657562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:07.658334 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:07.658797 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:07.785442 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:07.792990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-8a225114-f205-40de-8112-abd0c4a681f7 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.148076 Jun 15 10:39:07.793551 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 445/864] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:07 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:07.880583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:07.881269 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:07.887344 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:07.887787 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:07.888534 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:07.888961 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:07.953046 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:07.960384 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0e67e96f-9b64-464a-8280-0864fff646d0 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1270 microversion: 2.1 time: 0.085061 Jun 15 10:39:07.960942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 420/865] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:07 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:08.137247 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:08.137776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:08.143793 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:08.144247 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:08.144996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:08.145430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:08.276553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:08.284621 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9de47415-33d4-4669-a31c-90156ae27918 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1314 microversion: 2.1 time: 0.151449 Jun 15 10:39:08.285175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 446/866] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:08 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:08.810401 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:08.811011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:08.813485 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:08.819161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:08.819604 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:08.821070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:08.821677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:08.977512 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:08.979222 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:08.986756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:08.987287 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:08.988063 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:08.988540 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.055544 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:09.059868 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:09.067827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-da40261c-59f6-46aa-83f7-e6c0df48f14d tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.261940 Jun 15 10:39:09.068783 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 421/867] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:08 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:09.068923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c86eee4c-0969-4e26-a680-6a6f07cc3b1d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1276 microversion: 2.1 time: 0.095266 Jun 15 10:39:09.069579 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 447/868] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:08 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:09.210838 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-0bf1b272-51ff-42db-b479-5f69efa6c137 req-ae3cabf3-d322-4daf-b3f7-5ac42a0f07ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e775b471-43e7-42ee-b07a-50dc0d59e089", "name": "network-vif-plugged", "status": "completed", "tag": "8a090001-2a4e-434f-9f38-4a75764a65e9"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:09.219563 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-0bf1b272-51ff-42db-b479-5f69efa6c137 req-ae3cabf3-d322-4daf-b3f7-5ac42a0f07ac service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.220010 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-0bf1b272-51ff-42db-b479-5f69efa6c137 req-ae3cabf3-d322-4daf-b3f7-5ac42a0f07ac service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.231161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-0bf1b272-51ff-42db-b479-5f69efa6c137 req-ae3cabf3-d322-4daf-b3f7-5ac42a0f07ac service nova] Creating event network-vif-plugged:8a090001-2a4e-434f-9f38-4a75764a65e9 for instance e775b471-43e7-42ee-b07a-50dc0d59e089 on hv-cinder-84349 Jun 15 10:39:09.236088 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-0bf1b272-51ff-42db-b479-5f69efa6c137 req-ae3cabf3-d322-4daf-b3f7-5ac42a0f07ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028929 Jun 15 10:39:09.236683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 422/869] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:09.300421 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:09.301153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:09.308990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.309612 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.310382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.311017 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.449121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:09.457604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9dc6bdcf-bc40-4e31-95ff-33fa7838e993 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1464 microversion: 2.1 time: 0.160906 Jun 15 10:39:09.458179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 448/870] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:09 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:09.498331 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:09.498978 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:09.505665 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.506106 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.507215 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.507646 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.535835 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:39:09.615845 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-44caaf0e-f1c7-4168-9d67-98f56bc1ad04 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 204 len: 0 microversion: 2.1 time: 0.121298 Jun 15 10:39:09.616435 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 423/871] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:39:09 2022] DELETE /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:39:09.625434 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:09.626179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:09.632577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.633139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.633986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:09.634490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:09.775156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:09.783194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-90a8a508-de7e-4076-8ad8-381650aacfbc tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1470 microversion: 2.1 time: 0.162418 Jun 15 10:39:09.783753 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 449/872] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:09 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:10.086878 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:10.088631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:10.089762 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:10.090472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:10.097850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.098371 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.099245 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.099674 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.101556 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.102461 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.106500 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.107497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.232756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:10.240695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a257d5e4-7bf7-4ff1-be54-a05bddacf997 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.154936 Jun 15 10:39:10.241264 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 450/873] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:10 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:10.245639 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-3a28d085-cfe7-49c2-a0d8-d7c83ec4fa00 req-f6399231-b377-4720-9be7-8c0ebee98820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8378a647-7d0e-435f-8e73-7b57b250faa5", "tag": "12fca43d-5e94-42ef-b28d-a3f4d1fdfab6"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:10.253509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-3a28d085-cfe7-49c2-a0d8-d7c83ec4fa00 req-f6399231-b377-4720-9be7-8c0ebee98820 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.253952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-3a28d085-cfe7-49c2-a0d8-d7c83ec4fa00 req-f6399231-b377-4720-9be7-8c0ebee98820 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.259133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:10.264734 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-3a28d085-cfe7-49c2-a0d8-d7c83ec4fa00 req-f6399231-b377-4720-9be7-8c0ebee98820 service nova] Creating event network-changed:12fca43d-5e94-42ef-b28d-a3f4d1fdfab6 for instance 8378a647-7d0e-435f-8e73-7b57b250faa5 on hv-cinder-84349 Jun 15 10:39:10.266980 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-39aa46cb-4d80-4483-991c-1acfef0f5d01 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.185939 Jun 15 10:39:10.267578 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 424/874] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:10 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:10.270201 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-3a28d085-cfe7-49c2-a0d8-d7c83ec4fa00 req-f6399231-b377-4720-9be7-8c0ebee98820 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027810 Jun 15 10:39:10.270806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 451/875] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:10.801053 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:10.801657 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:10.807634 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.808074 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.808814 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:10.809267 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:10.941836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:10.949669 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-61367227-5bc4-43f7-bd22-4003e77b0c8c tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1470 microversion: 2.1 time: 0.152768 Jun 15 10:39:10.950245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 425/876] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:10 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:11.257472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:11.258077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:11.265043 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:11.265494 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:11.266260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:11.266700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:11.284513 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:11.285229 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:11.288529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:11.292308 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:11.292755 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:11.293515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:11.293943 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:11.414933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:11.423917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3ca1e077-29c1-408c-958f-46d9eb03ab00 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.170644 Jun 15 10:39:11.424517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 452/877] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:11 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:11.642569 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:11.650736 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c8614a3b-4ece-45dc-829f-d15e6a27ebdc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.370453 Jun 15 10:39:11.651354 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 426/878] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:11 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:11.965986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:11.966652 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:11.972785 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:11.973231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:11.973991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:11.974455 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.116641 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:12.124480 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cfeef147-4a3b-4be1-8fa3-b0b8fd275b55 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1470 microversion: 2.1 time: 0.162371 Jun 15 10:39:12.130257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 453/879] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:11 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:12.269768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-560595020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2010066906", "security_groups": [{"name": "tempest-secgroup-smoke-52272593"}], "block_device_mapping_v2": [{"uuid": "8c965996-65d0-4a87-9782-dcf9e411b7cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "104a1ab4-a947-4523-8e20-9882108d1335"}]}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:12.441609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:12.443511 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:12.451132 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.451720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.452513 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.452991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.455726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] validate_networks() for [('104a1ab4-a947-4523-8e20-9882108d1335', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:39:12.590648 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:12.598917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fb087679-f336-4bfe-b55a-c07016a4b16e tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.161999 Jun 15 10:39:12.599528 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 454/880] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:12 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:12.603902 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-2eb1d7f2-4361-4ce9-8685-2bed9955c7f1 req-8878057a-a99a-4483-8705-6ca38933bfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9a03b4-28e3-4086-8328-99534144d396", "name": "network-vif-deleted", "tag": "e0acd26a-d36d-43cf-8141-4a172d82a96b"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:12.612604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-2eb1d7f2-4361-4ce9-8685-2bed9955c7f1 req-8878057a-a99a-4483-8705-6ca38933bfc8 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.613048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-2eb1d7f2-4361-4ce9-8685-2bed9955c7f1 req-8878057a-a99a-4483-8705-6ca38933bfc8 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.623978 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-2eb1d7f2-4361-4ce9-8685-2bed9955c7f1 req-8878057a-a99a-4483-8705-6ca38933bfc8 service nova] Creating event network-vif-deleted:e0acd26a-d36d-43cf-8141-4a172d82a96b for instance 1e9a03b4-28e3-4086-8328-99534144d396 on hv-cinder-84349 Jun 15 10:39:12.629061 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-2eb1d7f2-4361-4ce9-8685-2bed9955c7f1 req-8878057a-a99a-4483-8705-6ca38933bfc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028367 Jun 15 10:39:12.629640 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 455/881] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:12.669044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:12.669862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:12.677645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.678177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.679164 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.679606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.840797 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:12.848683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e2b2743a-fe92-4eef-9d83-53bed16e57f3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1313 microversion: 2.1 time: 0.183990 Jun 15 10:39:12.849832 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 456/882] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:12 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:12.940163 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:39:12.940596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:39:12.941100 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:39:12.941511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:39:12.941921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:39:12.950693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.951181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.951980 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:12.952415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:12.969950 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:39:12.973922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for user 61bc9ad2c9444fc297eb4b5902a67b98 and project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:39:13.036304 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:39:13.038446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c965996-65d0-4a87-9782-dcf9e411b7cb',volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:39:13.142150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:13.142766 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:13.149515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.149948 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:13.150711 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.151184 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:13.164488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a4cab8b7-15bb-4734-aba0-4c10c2b8207d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.899334 Jun 15 10:39:13.165292 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 427/883] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:39:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:39:13.174829 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6000857d-af11-440e-9ac7-458f0c823848 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:13.175683 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6000857d-af11-440e-9ac7-458f0c823848 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:13.215928 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.216392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:13.216862 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lazy-loading 'fault' on Instance uuid 1e9a03b4-28e3-4086-8328-99534144d396 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:39:13.244640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6000857d-af11-440e-9ac7-458f0c823848 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:13.252477 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6000857d-af11-440e-9ac7-458f0c823848 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1094 microversion: 2.1 time: 0.081288 Jun 15 10:39:13.262157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 428/884] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:13 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:13.263466 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a8ea7b3022e44f48179326c25646c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab8980da8444a9789dd0c0b4b88aeac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:13.271944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-60c15a31-0da1-4984-8e87-59cdc510eae8 tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 200 len: 1304 microversion: 2.1 time: 0.134081 Jun 15 10:39:13.272857 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 457/885] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:13 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:13.614799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:13.615434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:13.622848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.623826 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:13.624405 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.625458 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:13.794417 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:13.798790 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:13.806879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-88a18dc3-83b7-4bc7-b3b1-f560079c15fb tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.195904 Jun 15 10:39:13.807549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 429/886] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:13 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:13.866701 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:13.867347 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:13.873866 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.874316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:13.875683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:13.876128 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.003030 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:14.010560 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-be3d2ee4-4d0c-4b83-a7e2-52c74881fc04 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1498 microversion: 2.1 time: 0.147840 Jun 15 10:39:14.011168 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 458/887] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:13 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:14.269943 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:14.270651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:14.273419 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:14.278885 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.279477 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.280295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.281227 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.289957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:14.290768 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] [instance: 1e9a03b4-28e3-4086-8328-99534144d396] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:14.297730 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.298348 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.299249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.299754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.313864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] HTTP exception thrown: Instance 1e9a03b4-28e3-4086-8328-99534144d396 could not be found. Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Request method failure captured: Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 HTTP/1.1 Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqba9luEMRs-gdpaT0DdY_-EKsvlX36r-iKoaz61Uf_BA-vsN9hy5OowvmYnlxLYtyoDgMn8iYP0rk_YhW8jRDLT8ylMar8ahKgXfv6aQwSzHYxo1vvj5G0Yo6jdJMGMjeKYUR_TLv8FpcBCMa_1U_ibyySxZ7Ifw-opd3PyPQM5BZxI Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: aab8980da8444a9789dd0c0b4b88aeac Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesNegativeTest-802815823 Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:39:14.315609 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/aab8980da8444a9789dd0c0b4b88aeac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aab8980da8444a9789dd0c0b4b88aeac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_aab8980da8444a9789dd0c0b4b88aeac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/aab8980da8444a9789dd0c0b4b88aeac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesNegativeTest-802815823 Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: aab8980da8444a9789dd0c0b4b88aeac Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesNegativeTest-802815823 Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesNegativeTest-802815823-project Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 8a8ea7b3022e44f48179326c25646c38 Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesNegativeTest-802815823-project Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 1e9a03b4-28e3-4086-8328-99534144d396 could not be found. Jun 15 10:39:14.317304 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '1e9a03b4-28e3-4086-8328-99534144d396'} Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9a03b4-28e3-4086-8328-99534144d396 could not be found. Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:39:14.318249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9a03b4-28e3-4086-8328-99534144d396 could not be found. Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9a03b4-28e3-4086-8328-99534144d396 could not be found. Jun 15 10:39:14.319806 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:14.321169 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] Returning 404 to user: Instance 1e9a03b4-28e3-4086-8328-99534144d396 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:39:14.321169 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d613cbd7-f9d2-4051-9594-4cff53de2afe tempest-VolumesNegativeTest-802815823 tempest-VolumesNegativeTest-802815823-project] 10.222.0.49 "GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396" status: 404 len: 111 microversion: 2.1 time: 0.030989 Jun 15 10:39:14.322344 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 459/888] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:14 2022] GET /compute/v2.1/servers/1e9a03b4-28e3-4086-8328-99534144d396 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:39:14.349801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:14.357272 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ca7bbcab-38ce-4a13-b91e-7c772e01c051 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1192 microversion: 2.1 time: 0.091491 Jun 15 10:39:14.357832 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 430/889] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:14 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:14.488851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:14.489425 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:14.496124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.496578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.497345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.497842 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.526184 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:39:14.609854 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-3c3d424e-6825-4213-858b-36c2d4975c6e tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 204 len: 0 microversion: 2.1 time: 0.124642 Jun 15 10:39:14.613725 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 460/890] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:39:14 2022] DELETE /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:39:14.619830 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:14.620648 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:14.628359 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.628809 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.629577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.630011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.763279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:14.771752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-517364f5-2041-4be5-92c8-6d46e8996708 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1504 microversion: 2.1 time: 0.156946 Jun 15 10:39:14.772661 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 431/891] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:14 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:14.824669 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:14.825586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:14.832023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.832473 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.833242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:14.833682 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:14.969030 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:14.976544 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-968861ef-49f9-4a40-ab2f-03a6f64c799d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.156149 Jun 15 10:39:14.977104 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 461/892] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:14 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:15.375186 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:15.376039 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:15.382888 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:15.383387 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:15.384164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:15.384586 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:15.449453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:15.457362 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-718e946e-0194-4238-a290-21a1c5d36a85 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1192 microversion: 2.1 time: 0.086011 Jun 15 10:39:15.457912 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 432/893] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:15 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:15.788855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:15.789486 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:15.795947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:15.796459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:15.798076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:15.798430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:15.931278 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:15.939186 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-89f856ef-948d-424e-9765-da7917d5929b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1504 microversion: 2.1 time: 0.154031 Jun 15 10:39:15.939763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 462/894] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:15 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:15.992921 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:15.993455 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:16.000358 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:16.000796 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:16.001581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:16.002012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:16.144194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:16.152295 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-131c17e8-6744-41a4-b4b9-25087b302a97 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.163284 Jun 15 10:39:16.152857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 433/895] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:15 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:16.474066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:16.475611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:16.478796 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:16.482990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:16.483468 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:16.484787 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:16.495869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:16.597536 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:16.608380 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aa17dded-1401-4b30-9ee4-16089d71bbe1 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1210 microversion: 2.1 time: 0.138036 Jun 15 10:39:16.624608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 463/896] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:16 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1210 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:16.956963 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:16.957576 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:16.977143 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:16.977599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:16.978388 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:16.978827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:17.166760 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:17.167661 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=14 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:17.172689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:17.173315 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:17.182950 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:17.183445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:17.184289 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:17.190550 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:17.394562 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:17.407001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f4d4728f-b76a-4fc8-b32d-b7c7874badd5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.240884 Jun 15 10:39:17.418367 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 464/897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:17 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:17.425145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-51f587a2-58b0-4112-9439-575fd9d8af67 req-07905caf-a984-426e-a3a3-efc6ff5c2a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e775b471-43e7-42ee-b07a-50dc0d59e089", "name": "network-vif-deleted", "tag": "8a090001-2a4e-434f-9f38-4a75764a65e9"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:17.434518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-51f587a2-58b0-4112-9439-575fd9d8af67 req-07905caf-a984-426e-a3a3-efc6ff5c2a37 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:17.435538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-51f587a2-58b0-4112-9439-575fd9d8af67 req-07905caf-a984-426e-a3a3-efc6ff5c2a37 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:17.451257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-51f587a2-58b0-4112-9439-575fd9d8af67 req-07905caf-a984-426e-a3a3-efc6ff5c2a37 service nova] Creating event network-vif-deleted:8a090001-2a4e-434f-9f38-4a75764a65e9 for instance e775b471-43e7-42ee-b07a-50dc0d59e089 on hv-cinder-84349 Jun 15 10:39:17.457987 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-51f587a2-58b0-4112-9439-575fd9d8af67 req-07905caf-a984-426e-a3a3-efc6ff5c2a37 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037235 Jun 15 10:39:17.459712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 465/898] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:17.474917 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:17.489742 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-80084acf-8648-4f73-8437-bd0128d67270 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 200 len: 1504 microversion: 2.1 time: 0.537054 Jun 15 10:39:17.490621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 434/899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:16 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 1504 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:17.627608 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:17.628185 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:17.634565 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:17.635018 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:17.635820 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:17.636260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:17.704690 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:17.718537 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-31d20d2a-b94c-497e-8075-19397184a864 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1198 microversion: 2.1 time: 0.095847 Jun 15 10:39:17.719604 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 466/900] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:17 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:18.427465 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:18.428572 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:18.439041 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:18.440259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:18.441219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:18.441991 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:18.507388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:18.509189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: e775b471-43e7-42ee-b07a-50dc0d59e089] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:18.516956 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:18.517887 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:18.519120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:18.519788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:18.538252 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] HTTP exception thrown: Instance e775b471-43e7-42ee-b07a-50dc0d59e089 could not be found. Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Request method failure captured: Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 HTTP/1.1 Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqba_BooxJRfgodzgokG1wc4s9XLKO4AQKhz0EADePbf-q29scXezjtJo3HsvS45z-6lH5QnJVoPfP_jdq_IH9uM9BW18O5mzDETZFLPvbj91HocJwzTXZAzPOK3iOpxEbbLjqkZsyuDCArMVgwszainL6UVXhzP_eHsHDyJSZWwkJ7A Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 3efa3522561147ac8eff67781403423e Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesActionsTest-1276545175 Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:39:18.540221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3efa3522561147ac8eff67781403423e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3efa3522561147ac8eff67781403423e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3efa3522561147ac8eff67781403423e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3efa3522561147ac8eff67781403423e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesActionsTest-1276545175 Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 3efa3522561147ac8eff67781403423e Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesActionsTest-1276545175 Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesActionsTest-1276545175-project Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 07276de63b65403585d0d7c576447f96 Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesActionsTest-1276545175-project Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance e775b471-43e7-42ee-b07a-50dc0d59e089 could not be found. Jun 15 10:39:18.541676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'e775b471-43e7-42ee-b07a-50dc0d59e089'} Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e775b471-43e7-42ee-b07a-50dc0d59e089 could not be found. Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:39:18.542458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e775b471-43e7-42ee-b07a-50dc0d59e089 could not be found. Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e775b471-43e7-42ee-b07a-50dc0d59e089 could not be found. Jun 15 10:39:18.544695 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:18.546702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Returning 404 to user: Instance e775b471-43e7-42ee-b07a-50dc0d59e089 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:39:18.546702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a5180fee-99c5-47d5-9e12-841156719f98 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089" status: 404 len: 111 microversion: 2.1 time: 0.038510 Jun 15 10:39:18.546702 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 467/901] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:18 2022] GET /compute/v2.1/servers/e775b471-43e7-42ee-b07a-50dc0d59e089 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:39:18.690938 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1807414609", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "networks": [{"uuid": "7dd91b3b-0ef5-4a72-9997-b791d1b8253c"}]}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:18.756462 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:18.767999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9f907357-fbd8-4b67-8cc2-b69b9234acc3 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.346180 Jun 15 10:39:18.769714 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 435/902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:18 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:18.775298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:18.776109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:18.784999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:18.785931 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:18.787341 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:18.788472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:18.790205 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] validate_networks() for [('7dd91b3b-0ef5-4a72-9997-b791d1b8253c', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:39:19.066825 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:19.080498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-09c4be0c-bd63-4c03-b165-1aa3d4e92259 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.308891 Jun 15 10:39:19.081364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 436/903] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:18 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:19.115128 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-f2298d80-e6b4-458a-b618-42defef95529 req-ae8716cf-a21a-4121-a131-c15a79eef139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8378a647-7d0e-435f-8e73-7b57b250faa5", "name": "network-vif-plugged", "status": "completed", "tag": "12fca43d-5e94-42ef-b28d-a3f4d1fdfab6"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:19.134665 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-f2298d80-e6b4-458a-b618-42defef95529 req-ae8716cf-a21a-4121-a131-c15a79eef139 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:19.137072 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-f2298d80-e6b4-458a-b618-42defef95529 req-ae8716cf-a21a-4121-a131-c15a79eef139 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:19.160130 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-f2298d80-e6b4-458a-b618-42defef95529 req-ae8716cf-a21a-4121-a131-c15a79eef139 service nova] Creating event network-vif-plugged:12fca43d-5e94-42ef-b28d-a3f4d1fdfab6 for instance 8378a647-7d0e-435f-8e73-7b57b250faa5 on hv-cinder-84349 Jun 15 10:39:19.173649 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-f2298d80-e6b4-458a-b618-42defef95529 req-ae8716cf-a21a-4121-a131-c15a79eef139 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066257 Jun 15 10:39:19.174250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 437/904] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:39:19.479584 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-88558e5d-22ed-45fe-9307-c3ed668601eb req-04fb49a7-9c64-4d94-a8a7-6325b35cdfdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2626cd15-7eaf-42ac-adce-e523831ee0c7", "tag": "e167a1a5-8acd-4587-800d-75d04b74e52e"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:19.488791 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-88558e5d-22ed-45fe-9307-c3ed668601eb req-04fb49a7-9c64-4d94-a8a7-6325b35cdfdc service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:19.489266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-88558e5d-22ed-45fe-9307-c3ed668601eb req-04fb49a7-9c64-4d94-a8a7-6325b35cdfdc service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:19.495774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:39:19.496190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:39:19.497000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:39:19.497130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:39:19.497437 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:39:19.506657 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:19.507237 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:19.507577 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-88558e5d-22ed-45fe-9307-c3ed668601eb req-04fb49a7-9c64-4d94-a8a7-6325b35cdfdc service nova] Creating event network-changed:e167a1a5-8acd-4587-800d-75d04b74e52e for instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 on hv-cinder-84349 Jun 15 10:39:19.508024 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:19.508448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:19.512711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-88558e5d-22ed-45fe-9307-c3ed668601eb req-04fb49a7-9c64-4d94-a8a7-6325b35cdfdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038119 Jun 15 10:39:19.513433 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 438/905] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:39:19.527375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Getting quotas for project 3efa3522561147ac8eff67781403423e. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:39:19.531416 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Getting quotas for user 07276de63b65403585d0d7c576447f96 and project 3efa3522561147ac8eff67781403423e. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:39:19.542375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:39:19.544667 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:39:19.589462 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2156e99c-a3a0-4ecc-bab7-93b8f682030a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903618 Jun 15 10:39:19.590095 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 468/906] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 10:39:19.600977 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-33fe06ca-2fd5-45ea-b5ff-5fdccf7364f2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:19.601764 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-33fe06ca-2fd5-45ea-b5ff-5fdccf7364f2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:19.659543 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-33fe06ca-2fd5-45ea-b5ff-5fdccf7364f2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:19.666246 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-33fe06ca-2fd5-45ea-b5ff-5fdccf7364f2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1214 microversion: 2.1 time: 0.069424 Jun 15 10:39:19.667144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 439/907] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:19 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:19.786249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:19.788623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:19.797493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:19.798620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:19.800463 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:19.801662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:20.030177 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:20.038354 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9a4910f7-15fd-47de-b815-c65c47f64cf2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.257074 Jun 15 10:39:20.039141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 469/908] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:19 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:20.098433 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:20.099146 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:20.105755 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:20.106462 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:20.107273 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:20.107712 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:20.344062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:20.352237 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b6c4dbf4-7ca3-43ea-8516-8f595fee94e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.257763 Jun 15 10:39:20.352793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 440/909] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:20 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:20.683860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:20.684529 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:20.690939 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:20.693860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:20.695251 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:20.696237 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:20.729109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:20.798573 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:20.808611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9d8c1102-2e5b-4d98-9134-44ca36ec8cf3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1210 microversion: 2.1 time: 0.128542 Jun 15 10:39:20.809781 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 470/910] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:20 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:21.055888 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:21.056600 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:21.064778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:21.065553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:21.066565 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:21.067062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:21.369241 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:21.369853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:21.376457 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:21.376909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:21.377686 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:21.378126 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:21.532483 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:21.540504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f4b5e691-5fd6-4902-aa81-c46857270037 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.175200 Jun 15 10:39:21.541190 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 471/911] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:21 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:21.652735 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:21.661042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-70682195-b1bc-41a7-bbe6-d5360ed0010d tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1318 microversion: 2.1 time: 0.609005 Jun 15 10:39:21.661832 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 441/912] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:21 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:21.828157 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:21.828976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:21.838616 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:21.839280 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:21.840273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:21.840871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:21.956077 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:21.975733 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0a0f1902-61ea-41d7-982c-b09d599c1ad2 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1284 microversion: 2.1 time: 0.153470 Jun 15 10:39:21.980031 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 472/913] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:21 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:22.557860 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:22.558901 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:22.565764 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:22.566220 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:22.566995 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:22.567626 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:22.678646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:22.679293 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:22.685330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:22.685776 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:22.686542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:22.687010 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:22.813334 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:22.823385 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-722023f8-fe9f-4f5e-93eb-201dcbb13eed tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.269197 Jun 15 10:39:22.824728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 442/914] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:22 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:22.830865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:22.839478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9ce1f274-d20e-422d-b0ad-1be417fc1dca tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1506 microversion: 2.1 time: 0.164764 Jun 15 10:39:22.840038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 473/915] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:22 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:22.997010 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:22.997616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:23.000130 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:23.007185 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:23.007301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:23.007998 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:23.008735 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:23.242225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:23.253784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a59fb5f2-73d9-4dc6-b334-4a5566a569b9 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.260612 Jun 15 10:39:23.255112 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 443/916] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:22 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:23.847613 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:23.857097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:23.868969 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:23.869714 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:23.872145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:23.872754 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:24.146332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:24.162736 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-58805827-5613-4c70-b6cc-85cbec2fc401 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.322697 Jun 15 10:39:24.177627 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-dbec8739-c7fb-40f7-9918-a7da49dd04b4 req-a489839c-ab19-4deb-a702-51e70756a509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9242699d-f8d1-4e12-b56a-bf3a405596be", "tag": "11b43e2d-9ca6-4920-af3f-e9e01d523014"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:24.181436 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 474/917] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:23 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:24.189607 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-dbec8739-c7fb-40f7-9918-a7da49dd04b4 req-a489839c-ab19-4deb-a702-51e70756a509 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:24.190335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-dbec8739-c7fb-40f7-9918-a7da49dd04b4 req-a489839c-ab19-4deb-a702-51e70756a509 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:24.202489 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-dbec8739-c7fb-40f7-9918-a7da49dd04b4 req-a489839c-ab19-4deb-a702-51e70756a509 service nova] Creating event network-changed:11b43e2d-9ca6-4920-af3f-e9e01d523014 for instance 9242699d-f8d1-4e12-b56a-bf3a405596be on hv-cinder-84349 Jun 15 10:39:24.209107 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-dbec8739-c7fb-40f7-9918-a7da49dd04b4 req-a489839c-ab19-4deb-a702-51e70756a509 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037085 Jun 15 10:39:24.213759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 444/918] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:24.272451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:24.273069 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:24.289112 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:24.289791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:24.290757 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:24.291381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:24.534828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:24.544034 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1ef9322d-a997-4449-9790-4ab2264790c3 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.275815 Jun 15 10:39:24.545178 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 475/919] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:24 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:25.199237 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:25.200531 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:25.208774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:25.209231 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:25.210007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:25.210599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:25.378890 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:25.388189 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7710e4c6-3094-4f0b-8590-9a89170a723c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.193606 Jun 15 10:39:25.388933 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 445/920] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:25 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:25.561467 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:25.566586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:25.573729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:25.574246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:25.575126 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:25.575646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:25.744068 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:25.754223 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-479241ff-95c4-417e-870d-76615b722ead tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.197077 Jun 15 10:39:25.754782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 476/921] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:25 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:26.408192 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:26.409874 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:26.417284 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:26.418266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:26.420363 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:26.421706 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:26.785416 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:26.785416 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:26.800316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:26.801375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:26.802175 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:26.803137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:26.924187 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:26.934781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-02271f4a-45df-4342-ab98-b870b2ba9c9f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.533146 Jun 15 10:39:26.940219 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 446/922] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:26 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:27.146054 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:27.159405 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fbebecb7-d094-4fc8-a0ad-ebe780ea7259 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.389219 Jun 15 10:39:27.170756 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 477/923] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:26 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:27.959265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:27.960441 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:27.972833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:27.976866 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:27.978067 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:27.981092 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:28.177315 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:28.177952 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:28.189684 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:28.190037 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:28.190815 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:28.191274 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:28.279872 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:28.296902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e84370c5-a422-4491-ae97-f837788efc8f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.335276 Jun 15 10:39:28.297774 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 447/924] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:27 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:28.754075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:28.765996 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b1f6e142-8589-4504-ac41-5afa6fa32df4 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.592721 Jun 15 10:39:28.770569 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 478/925] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:28 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:29.314305 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:29.315530 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:29.329702 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:29.330329 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:29.331325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:29.331920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:29.665545 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=24 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:29.790829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:29.798800 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:29.814929 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:29.817685 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=6 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:29.820738 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:29.821191 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:29.821976 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:29.822548 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:29.931548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:29.950230 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a9fd45c7-1b33-4375-9822-0db642e9069c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.638166 Jun 15 10:39:29.951381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 448/926] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:29 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:30.124401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:30.138424 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-92520263-5c59-4961-bb89-1fe4cc055150 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.353870 Jun 15 10:39:30.139888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 479/927] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:29 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:30.969279 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:30.970644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:30.986591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:30.989495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:30.990394 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:30.990932 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:31.015200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=100 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:31.148926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:31.156179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:31.158666 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:31.171852 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:31.172316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:31.173086 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:31.175207 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0996dbea-0908-44d1-8bbb-dd30bc0b9da9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.210489 Jun 15 10:39:31.175782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 449/928] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:30 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:31.176514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:31.354547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:31.362861 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e0ab12cd-8423-49e5-8190-0eff47cb1adc tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.210651 Jun 15 10:39:31.363496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 480/929] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:31 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:31.521968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0551cf3c-f8b1-4118-b2f2-202401dd34ca tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Action: 'create', calling method: .version_select at 0x7feb3aa6c310>, body: {"keypair": {"name": "tempest-TestShelveInstance-129318747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaZken+9E/iw3X7PB8ie02fxGKqFweKOHa2jg9XsPoE+kzKEm5krFKHKmdv1LiksCmdlHITJWWoLeUmoNosbcgZTC3wpOXeEuNmzB7kor0yftj8+0yBscTXnTLT5+vdmQ=="}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:31.537984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-0551cf3c-f8b1-4118-b2f2-202401dd34ca tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Getting quotas for project fe56b435fdbf49629bfc5e06c24e78b9. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:39:31.541848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-0551cf3c-f8b1-4118-b2f2-202401dd34ca tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Getting quotas for user 0b4d91a8096f4f70983ebad7e097a78a and project fe56b435fdbf49629bfc5e06c24e78b9. Resources: {'key_pairs'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:39:31.567242 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0551cf3c-f8b1-4118-b2f2-202401dd34ca tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.238344 Jun 15 10:39:31.568398 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 450/930] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Jun 15 10:39:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:32.192838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:32.193650 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:32.200611 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:32.201067 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:32.201874 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:32.202346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:32.382902 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:32.386036 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:32.390271 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:32.400314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b7769ea3-d661-49e4-8aef-fddef1fb74b2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.211957 Jun 15 10:39:32.401109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:32.401801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:32.402609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:32.403265 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:32.407303 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 481/931] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:32 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:32.581214 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:32.589160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-716ff0df-c0f5-451c-bb38-d584d2a5d48b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.213066 Jun 15 10:39:32.589706 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 451/932] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:32 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:33.403538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-796ae747-b712-47e3-8c6d-165ec200ef39 req-55b576c9-157d-4488-8a8e-a58723417a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2626cd15-7eaf-42ac-adce-e523831ee0c7", "name": "network-vif-plugged", "status": "completed", "tag": "e167a1a5-8acd-4587-800d-75d04b74e52e"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:33.415567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-796ae747-b712-47e3-8c6d-165ec200ef39 req-55b576c9-157d-4488-8a8e-a58723417a33 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:33.416023 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-796ae747-b712-47e3-8c6d-165ec200ef39 req-55b576c9-157d-4488-8a8e-a58723417a33 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:33.423940 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:33.427025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:33.435029 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:33.435674 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:33.437361 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:33.438364 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:33.439945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-796ae747-b712-47e3-8c6d-165ec200ef39 req-55b576c9-157d-4488-8a8e-a58723417a33 service nova] Creating event network-vif-plugged:e167a1a5-8acd-4587-800d-75d04b74e52e for instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 on hv-cinder-84349 Jun 15 10:39:33.445165 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-796ae747-b712-47e3-8c6d-165ec200ef39 req-55b576c9-157d-4488-8a8e-a58723417a33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Jun 15 10:39:33.445883 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 482/933] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:33.577690 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:33.588194 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a74f6a50-b87c-4d61-bf71-1105893f1f1b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.168751 Jun 15 10:39:33.588922 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 452/934] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:33 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:33.609141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:33.614715 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:33.624509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:33.626677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:33.628201 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:33.628755 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:33.806133 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:33.813817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-88d35e13-47ad-46da-80ea-85b0c9fd5076 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.209481 Jun 15 10:39:33.814394 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 483/935] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:33 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:34.605091 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:34.605694 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:34.612168 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:34.612609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:34.613353 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:34.613782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:34.744863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:34.753158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-eca01d3a-3663-48f7-bfb9-88956a704783 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1264 microversion: 2.1 time: 0.151911 Jun 15 10:39:34.753722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 453/936] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:34 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:34.829800 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:34.830410 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:34.836993 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:34.837438 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:34.838201 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:34.838633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:34.973309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:34.981371 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4d9afba8-b8f2-445d-b41c-77b03ce37c7c tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.155547 Jun 15 10:39:34.981930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 484/937] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:34 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:35.475304 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-1d592918-c3dc-4dfc-880f-59ed6faf7a1f req-2764c44f-ef7e-4846-8cd0-be2476e6a150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9242699d-f8d1-4e12-b56a-bf3a405596be", "name": "network-vif-plugged", "status": "completed", "tag": "11b43e2d-9ca6-4920-af3f-e9e01d523014"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:35.483363 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1d592918-c3dc-4dfc-880f-59ed6faf7a1f req-2764c44f-ef7e-4846-8cd0-be2476e6a150 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:35.483804 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1d592918-c3dc-4dfc-880f-59ed6faf7a1f req-2764c44f-ef7e-4846-8cd0-be2476e6a150 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:35.495192 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-1d592918-c3dc-4dfc-880f-59ed6faf7a1f req-2764c44f-ef7e-4846-8cd0-be2476e6a150 service nova] Creating event network-vif-plugged:11b43e2d-9ca6-4920-af3f-e9e01d523014 for instance 9242699d-f8d1-4e12-b56a-bf3a405596be on hv-cinder-84349 Jun 15 10:39:35.500401 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-1d592918-c3dc-4dfc-880f-59ed6faf7a1f req-2764c44f-ef7e-4846-8cd0-be2476e6a150 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028758 Jun 15 10:39:35.501050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 454/938] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:35.771538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:35.772601 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:35.784232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:35.785441 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:35.786977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:35.787648 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:35.945448 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:35.953626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7d775fec-63e5-4b77-9785-acab82b779f4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1449 microversion: 2.1 time: 0.187041 Jun 15 10:39:35.954145 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 485/939] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:35 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:35.971693 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:35.972328 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:35.978820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:35.979313 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:35.980096 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:35.980532 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:35.998009 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:35.998810 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:36.005066 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:36.005597 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:36.006439 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:36.006944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:36.142784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:36.148388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:36.155502 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-16443ab3-9b17-4d4f-ac94-d4e06425c035 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1449 microversion: 2.1 time: 0.188588 Jun 15 10:39:36.156318 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 455/940] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:35 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1449 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:36.156445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-410d4e74-108c-447b-a1b2-ad05480a2d95 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.162328 Jun 15 10:39:36.157194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 486/941] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:35 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:37.176698 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:37.177446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:37.185633 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:37.186153 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:37.187932 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:37.188575 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:37.351665 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:37.360205 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-af88e4a6-7516-4635-9031-446aa209d0ee tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1314 microversion: 2.1 time: 0.190530 Jun 15 10:39:37.360882 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 456/942] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:37 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:38.372935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-21123871-5ba1-4c06-bfca-750171844fe0 req-b810d02e-c8c1-4e59-ae44-06efa2312e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2626cd15-7eaf-42ac-adce-e523831ee0c7", "tag": "e167a1a5-8acd-4587-800d-75d04b74e52e"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:38.377161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:38.377979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:38.382838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-21123871-5ba1-4c06-bfca-750171844fe0 req-b810d02e-c8c1-4e59-ae44-06efa2312e81 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:38.383316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-21123871-5ba1-4c06-bfca-750171844fe0 req-b810d02e-c8c1-4e59-ae44-06efa2312e81 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:38.386132 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:38.386841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:38.387925 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:38.388798 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:38.396307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-21123871-5ba1-4c06-bfca-750171844fe0 req-b810d02e-c8c1-4e59-ae44-06efa2312e81 service nova] Creating event network-changed:e167a1a5-8acd-4587-800d-75d04b74e52e for instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 on hv-cinder-84349 Jun 15 10:39:38.402575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-21123871-5ba1-4c06-bfca-750171844fe0 req-b810d02e-c8c1-4e59-ae44-06efa2312e81 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103527 Jun 15 10:39:38.407401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 487/943] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:39:38.419817 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58582981-4ab1-48ce-a244-7278901fc547", "device": "/dev/sdb"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:38.422193 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:38.429383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:38.430187 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:38.431489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:38.432137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:38.451517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:38.703857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:38.713699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bb277561-7872-421c-b27c-8b6d1f86f982 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1498 microversion: 2.1 time: 0.340787 Jun 15 10:39:38.715425 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 457/944] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:38 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1498 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:38.786733 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cc306a3f-a310-4ae1-b838-41a021e468fc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "POST /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370846 Jun 15 10:39:38.787527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 488/945] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:39:38 2022] POST /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:39:39.418270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:39.418782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:39.425681 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:39.426125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:39.426879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:39.427340 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:39.451978 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:39:39.525579 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ea1474b6-574c-452f-abcc-e2e965f1fc5b tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 204 len: 0 microversion: 2.1 time: 0.110672 Jun 15 10:39:39.526175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 458/946] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:39:39 2022] DELETE /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:39:39.537812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:39.538525 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:39.546372 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:39.547266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:39.547946 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:39.548689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:39.696724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:39.704760 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dcaf9667-0ae2-4799-8e39-4d3608276324 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1504 microversion: 2.1 time: 0.173583 Jun 15 10:39:39.705258 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 489/947] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:39 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:40.722377 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:40.723079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:40.729761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:40.730213 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:40.730975 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:40.731481 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:40.865054 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:40.872641 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-33034e7e-da7d-486b-b965-dde491fd9d2a tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1504 microversion: 2.1 time: 0.154491 Jun 15 10:39:40.873202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 459/948] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:40 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:39:41.693833 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-1f571a28-697a-43a4-8557-27aab77c96d7 req-7b7fc82a-76fa-43c8-9d39-684d3cefe3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9242699d-f8d1-4e12-b56a-bf3a405596be", "name": "network-vif-deleted", "tag": "11b43e2d-9ca6-4920-af3f-e9e01d523014"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:41.704281 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-1f571a28-697a-43a4-8557-27aab77c96d7 req-7b7fc82a-76fa-43c8-9d39-684d3cefe3f4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:41.704614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-1f571a28-697a-43a4-8557-27aab77c96d7 req-7b7fc82a-76fa-43c8-9d39-684d3cefe3f4 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:41.716440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-1f571a28-697a-43a4-8557-27aab77c96d7 req-7b7fc82a-76fa-43c8-9d39-684d3cefe3f4 service nova] Creating event network-vif-deleted:11b43e2d-9ca6-4920-af3f-e9e01d523014 for instance 9242699d-f8d1-4e12-b56a-bf3a405596be on hv-cinder-84349 Jun 15 10:39:41.721984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-1f571a28-697a-43a4-8557-27aab77c96d7 req-7b7fc82a-76fa-43c8-9d39-684d3cefe3f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033199 Jun 15 10:39:41.722757 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 490/949] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:39:41.891504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:41.892948 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:41.896483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=4 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:41.900981 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:41.901422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:41.902187 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:41.902635 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:41.936202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:41.936753 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:41.937966 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lazy-loading 'fault' on Instance uuid 9242699d-f8d1-4e12-b56a-bf3a405596be {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:39:41.979659 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07276de63b65403585d0d7c576447f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efa3522561147ac8eff67781403423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:41.987864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4245ec91-3947-4aea-8900-1652f56a69b0 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 200 len: 1304 microversion: 2.1 time: 0.100772 Jun 15 10:39:41.988653 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 460/950] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:41 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:39:43.008012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:43.009427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] [instance: 9242699d-f8d1-4e12-b56a-bf3a405596be] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:43.016677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:43.017133 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:43.017923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:43.018362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:43.033908 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] HTTP exception thrown: Instance 9242699d-f8d1-4e12-b56a-bf3a405596be could not be found. Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Request method failure captured: Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be HTTP/1.1 Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqba_BooxJRfgodzgokG1wc4s9XLKO4AQKhz0EADePbf-q29scXezjtJo3HsvS45z-6lH5QnJVoPfP_jdq_IH9uM9BW18O5mzDETZFLPvbj91HocJwzTXZAzPOK3iOpxEbbLjqkZsyuDCArMVgwszainL6UVXhzP_eHsHDyJSZWwkJ7A Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 3efa3522561147ac8eff67781403423e Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesActionsTest-1276545175 Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:39:43.035748 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3efa3522561147ac8eff67781403423e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3efa3522561147ac8eff67781403423e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3efa3522561147ac8eff67781403423e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3efa3522561147ac8eff67781403423e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesActionsTest-1276545175 Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 3efa3522561147ac8eff67781403423e Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesActionsTest-1276545175 Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesActionsTest-1276545175-project Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 07276de63b65403585d0d7c576447f96 Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesActionsTest-1276545175-project Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 9242699d-f8d1-4e12-b56a-bf3a405596be could not be found. Jun 15 10:39:43.037231 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '9242699d-f8d1-4e12-b56a-bf3a405596be'} Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9242699d-f8d1-4e12-b56a-bf3a405596be could not be found. Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:39:43.038044 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9242699d-f8d1-4e12-b56a-bf3a405596be could not be found. Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9242699d-f8d1-4e12-b56a-bf3a405596be could not be found. Jun 15 10:39:43.039383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:39:43.040580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] Returning 404 to user: Instance 9242699d-f8d1-4e12-b56a-bf3a405596be could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:39:43.040580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b52bf9bd-3a8a-432c-a820-d914869db607 tempest-VolumesActionsTest-1276545175 tempest-VolumesActionsTest-1276545175-project] 10.222.0.49 "GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be" status: 404 len: 111 microversion: 2.1 time: 0.034371 Jun 15 10:39:43.040580 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 491/951] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:43 2022] GET /compute/v2.1/servers/9242699d-f8d1-4e12-b56a-bf3a405596be => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 10:39:58.559491 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-932414167", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-129318747", "security_groups": [{"name": "tempest-secgroup-smoke-649399160"}], "networks": [{"uuid": "6c676230-a21e-47f7-b248-35e003e07d94"}], "block_device_mapping_v2": [{"uuid": "1819d695-a813-4c9d-b888-1d923fa2721a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:39:58.572374 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:58.573496 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:58.715396 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] validate_networks() for [('6c676230-a21e-47f7-b248-35e003e07d94', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:39:59.104079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:39:59.104448 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:39:59.104923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:39:59.105335 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:39:59.105750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:39:59.115312 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:59.115771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:59.116572 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:39:59.119038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:39:59.141871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Getting quotas for project fe56b435fdbf49629bfc5e06c24e78b9. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:39:59.148445 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Getting quotas for user 0b4d91a8096f4f70983ebad7e097a78a and project fe56b435fdbf49629bfc5e06c24e78b9. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:39:59.212094 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:39:59.214260 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1819d695-a813-4c9d-b888-1d923fa2721a',volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:39:59.375045 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-bcad3113-83f2-4ddb-9f73-91dd4cee05bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.821237 Jun 15 10:39:59.381135 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 461/952] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:39:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:39:59.390954 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c3058595-155c-4261-82e6-d33a9ccfd910 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:39:59.392135 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c3058595-155c-4261-82e6-d33a9ccfd910 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:39:59.398314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:59.399524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:59.464179 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c3058595-155c-4261-82e6-d33a9ccfd910 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:39:59.472980 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c3058595-155c-4261-82e6-d33a9ccfd910 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1087 microversion: 2.1 time: 0.090583 Jun 15 10:39:59.474181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 492/953] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:39:59 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1087 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:00.491053 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:00.491923 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:00.498703 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:00.500070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:00.501054 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:00.501713 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:00.570778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:00.579600 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-14614485-2416-41b1-85bf-efe984d6912e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1137 microversion: 2.1 time: 0.093200 Jun 15 10:40:00.580162 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 462/954] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:00 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:01.599346 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:01.600490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:01.609124 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:01.609821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:01.610600 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:01.611031 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:01.685692 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:01.695204 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b82d8d7e-44f4-471f-bd17-ef66a7398972 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1185 microversion: 2.1 time: 0.102768 Jun 15 10:40:01.696039 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 493/955] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:01 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:40:02.711877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:02.712412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:02.723415 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:02.724120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:02.725129 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:02.726581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:02.867749 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:02.877042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-25bae5b9-1afd-4c63-884f-819bb13fbcb4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1203 microversion: 2.1 time: 0.169534 Jun 15 10:40:02.877619 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 463/956] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:02 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:03.873416 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-d196505e-39a5-4860-9855-b0783bf7338e req-414e1c93-f29f-4b54-b821-68d622d56dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:03.892631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-d196505e-39a5-4860-9855-b0783bf7338e req-414e1c93-f29f-4b54-b821-68d622d56dd3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:03.893076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-d196505e-39a5-4860-9855-b0783bf7338e req-414e1c93-f29f-4b54-b821-68d622d56dd3 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:03.895101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:03.896311 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:03.903877 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:03.905616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:03.907969 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:03.909236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:03.913979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-d196505e-39a5-4860-9855-b0783bf7338e req-414e1c93-f29f-4b54-b821-68d622d56dd3 service nova] Creating event network-changed:94642a1a-1e5d-4c38-8e39-fe86241784ed for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e on hv-cinder-84349 Jun 15 10:40:03.920011 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-d196505e-39a5-4860-9855-b0783bf7338e req-414e1c93-f29f-4b54-b821-68d622d56dd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051753 Jun 15 10:40:03.921305 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 494/957] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:04.142417 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:04.150198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cfa1fafe-91ec-4618-9a56-7997c7958e1d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.259765 Jun 15 10:40:04.150749 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 464/958] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:03 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:40:05.170825 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:05.171550 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:05.177791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:05.178283 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:05.179046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:05.179502 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:05.318423 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:05.326084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2a742457-a985-4be1-b2fe-5be2d0069fc7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.160271 Jun 15 10:40:05.326729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 495/959] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:05 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:05.833811 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:05.834302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:05.840873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:05.841314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:05.842057 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:05.842991 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:05.925121 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lazy-loading 'services' on Instance uuid 8378a647-7d0e-435f-8e73-7b57b250faa5 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:40:05.995757 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f536bcff-f305-499b-8611-b1ab68eb4ad4 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5/os-volume_attachments/58582981-4ab1-48ce-a244-7278901fc547" status: 202 len: 0 microversion: 2.1 time: 0.165591 Jun 15 10:40:05.996728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 465/960] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:40:05 2022] DELETE /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5/os-volume_attachments/58582981-4ab1-48ce-a244-7278901fc547 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:40:06.342678 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:06.343383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:06.350118 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:06.350664 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:06.351509 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:06.351945 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:06.493474 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:06.502445 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e43b3b92-d15f-40f9-bae2-a32fdab75d97 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.163509 Jun 15 10:40:06.503109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 496/961] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:06 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:07.120854 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:07.121435 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:07.128316 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:07.128759 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:07.129515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:07.129968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:07.154548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:40:07.225839 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4b6c8770-5c15-4897-955f-e39e1805b8ed tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 204 len: 0 microversion: 2.1 time: 0.109323 Jun 15 10:40:07.226408 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 466/962] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:40:07 2022] DELETE /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 10:40:07.235557 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:07.236194 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:07.242260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:07.242704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:07.243506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:07.243943 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:07.369821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:07.377290 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cdbaeb3c-6bd9-4e45-8980-672ce48a79a9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1512 microversion: 2.1 time: 0.146659 Jun 15 10:40:07.377847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 497/963] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:07 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:07.519514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:07.520202 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:07.526387 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:07.526827 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:07.527618 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:07.528050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:07.658024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:07.665384 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-37e2a57d-eca3-4a5c-825a-35b1a5b26cf2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.150054 Jun 15 10:40:07.665934 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 467/964] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:07 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:08.394382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:08.395153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:08.401915 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:08.402368 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:08.403157 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:08.403598 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:08.532669 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:08.540141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-6450ff73-549c-4ad0-936b-1e239c1e140b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1512 microversion: 2.1 time: 0.150252 Jun 15 10:40:08.540727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 498/965] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:08 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:08.681927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:08.682575 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:08.689634 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:08.690076 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:08.690833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:08.691296 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:08.817466 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:08.824983 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-73d17ca9-f7f9-4a5f-a3c2-0ce9c1cf81d3 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.146942 Jun 15 10:40:08.825546 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 468/966] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:08 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:09.557640 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:09.558303 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:09.560841 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:09.567229 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:09.567684 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:09.568464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:09.568903 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:09.697151 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:09.705546 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-123ff082-017b-467a-9df3-24523d616ac8 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1512 microversion: 2.1 time: 0.151833 Jun 15 10:40:09.706119 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 499/967] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:09 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:09.802989 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-ecd683d2-a8b9-4e7b-9255-106977417854 req-c7d0e01d-ee73-46c1-992c-85be1ea7b7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8378a647-7d0e-435f-8e73-7b57b250faa5", "name": "network-vif-deleted", "tag": "12fca43d-5e94-42ef-b28d-a3f4d1fdfab6"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:09.806567 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:09.807256 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:09.814603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-ecd683d2-a8b9-4e7b-9255-106977417854 req-c7d0e01d-ee73-46c1-992c-85be1ea7b7db service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:09.815044 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-ecd683d2-a8b9-4e7b-9255-106977417854 req-c7d0e01d-ee73-46c1-992c-85be1ea7b7db service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:09.828801 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-ecd683d2-a8b9-4e7b-9255-106977417854 req-c7d0e01d-ee73-46c1-992c-85be1ea7b7db service nova] Creating event network-vif-deleted:12fca43d-5e94-42ef-b28d-a3f4d1fdfab6 for instance 8378a647-7d0e-435f-8e73-7b57b250faa5 on hv-cinder-84349 Jun 15 10:40:09.833534 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-ecd683d2-a8b9-4e7b-9255-106977417854 req-c7d0e01d-ee73-46c1-992c-85be1ea7b7db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034258 Jun 15 10:40:09.834107 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 469/968] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:09.841384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:09.841998 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:09.848181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:09.848631 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:09.849390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:09.849826 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:09.988527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:09.996065 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cdf3dfcd-c54c-4416-abf7-d9ae0d151515 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.158514 Jun 15 10:40:09.996627 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 500/969] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:09 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:10.724489 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:10.725181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:10.731389 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:10.731836 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:10.732598 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:10.733038 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:10.762401 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:10.762842 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:10.763323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lazy-loading 'fault' on Instance uuid 8378a647-7d0e-435f-8e73-7b57b250faa5 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:40:10.804795 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:10.812689 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b3d9c027-4579-4a44-9050-aaf548674078 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 200 len: 1308 microversion: 2.1 time: 0.092431 Jun 15 10:40:10.813239 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 470/970] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:10 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:11.013545 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:11.014089 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:11.021332 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:11.021860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:11.022873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:11.023440 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:11.153559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:11.161154 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-996311a5-bb24-493d-9fd1-37486bdec40a tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.151587 Jun 15 10:40:11.161709 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 501/971] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:11 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:11.829497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:11.830101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: 8378a647-7d0e-435f-8e73-7b57b250faa5] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:11.836639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:11.837084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:11.837843 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:11.838277 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:11.852232 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] HTTP exception thrown: Instance 8378a647-7d0e-435f-8e73-7b57b250faa5 could not be found. Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Request method failure captured: Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 HTTP/1.1 Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqbbI-BCc1xkGv_-EBpQdm_Div8ShnF-t6RTgDGcuBM_2gX0NRH-Djmh_i3l9VQtLZTywWFSQXxsHVhtoA6dqQODbDji40mS-2Pap9wla-iYtBXfZZgV6eFqBkTRHb7RAX4fYkvB00yeCYTUwOkntvGr2pTZkFw7zyBPnP971IMbHhCo Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: 129b7faaaf264434baf88ffe0fe9bb25 Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-VolumesSnapshotTestJSON-377415052 Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:40:11.853834 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-VolumesSnapshotTestJSON-377415052 Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: 129b7faaaf264434baf88ffe0fe9bb25 Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-377415052 Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-VolumesSnapshotTestJSON-377415052-project Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 46fc1f62b79541e7a550731ee4728637 Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-VolumesSnapshotTestJSON-377415052-project Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 8378a647-7d0e-435f-8e73-7b57b250faa5 could not be found. Jun 15 10:40:11.855570 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '8378a647-7d0e-435f-8e73-7b57b250faa5'} Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8378a647-7d0e-435f-8e73-7b57b250faa5 could not be found. Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:40:11.856571 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8378a647-7d0e-435f-8e73-7b57b250faa5 could not be found. Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8378a647-7d0e-435f-8e73-7b57b250faa5 could not be found. Jun 15 10:40:11.857952 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:40:11.859841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Returning 404 to user: Instance 8378a647-7d0e-435f-8e73-7b57b250faa5 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:40:11.859841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0a5397e9-4dad-4467-8fe4-68fa93576aa9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5" status: 404 len: 111 microversion: 2.1 time: 0.029698 Jun 15 10:40:11.859841 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 471/972] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:11 2022] GET /compute/v2.1/servers/8378a647-7d0e-435f-8e73-7b57b250faa5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:40:12.177761 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:12.178369 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:12.184869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:12.185302 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:12.186094 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:12.186530 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:12.312412 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:12.319978 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-edd97c22-9116-4fd4-a16e-b90f25d2b110 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.146168 Jun 15 10:40:12.320576 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 502/973] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:12 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:13.336984 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:13.337520 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:13.344580 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:13.345022 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:13.345768 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:13.346200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:13.475244 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:13.482691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6906c7f7-e9a2-4a3a-8c18-455fdf752cd4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.149616 Jun 15 10:40:13.483283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 472/974] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:13 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:14.499763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:14.500373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:14.507117 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:14.507567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:14.508328 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:14.508762 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:14.639219 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:14.647109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-36cdf94e-6912-4165-a5e2-28c9ddaab51d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.151199 Jun 15 10:40:14.647935 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 503/975] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:14 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:15.665043 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:15.665650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:15.672750 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:15.673191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:15.673939 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:15.674373 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:15.800973 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:15.808637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2b0e6ce0-e3bc-445e-b137-d9bb407e2a05 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.147441 Jun 15 10:40:15.809185 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 473/976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:15 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:16.825624 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:16.826236 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:16.832840 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:16.833288 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:16.834058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:16.834493 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:16.960715 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:16.968208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7192db7a-8755-443d-807f-cf4c2ed77b69 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.146452 Jun 15 10:40:16.968972 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 504/977] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:16 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:17.985558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:17.986171 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:17.992798 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:17.993243 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:17.993997 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:17.994427 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:18.119873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:18.127368 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-76bb1712-1172-474e-a931-7c27030fa009 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.146557 Jun 15 10:40:18.127925 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 474/978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:17 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:18.461727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-af0a441d-274b-4238-ac42-12b7bab48031 req-d1e06507-536b-4cd6-8b2b-4a65a541f956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "name": "network-vif-plugged", "status": "completed", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:18.471646 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-af0a441d-274b-4238-ac42-12b7bab48031 req-d1e06507-536b-4cd6-8b2b-4a65a541f956 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:18.472091 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-af0a441d-274b-4238-ac42-12b7bab48031 req-d1e06507-536b-4cd6-8b2b-4a65a541f956 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:18.484343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-af0a441d-274b-4238-ac42-12b7bab48031 req-d1e06507-536b-4cd6-8b2b-4a65a541f956 service nova] Creating event network-vif-plugged:94642a1a-1e5d-4c38-8e39-fe86241784ed for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e on hv-cinder-84349 Jun 15 10:40:18.489253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-af0a441d-274b-4238-ac42-12b7bab48031 req-d1e06507-536b-4cd6-8b2b-4a65a541f956 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031175 Jun 15 10:40:18.489847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 505/979] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:19.144330 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:19.144871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:19.151677 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:19.152153 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:19.152938 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:19.153374 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:19.284618 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:19.292201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-31270709-a096-4149-863c-f9ff93965781 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.152248 Jun 15 10:40:19.292780 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 475/980] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:19 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:40:19.640107 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2058219793", "imageRef": "380dc3d8-ea9b-4836-b2ea-451270f9150f", "flavorRef": "452", "networks": [{"uuid": "38c3248b-0ee1-440d-9b31-0c1018fc7378"}]}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:19.691930 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] validate_networks() for [('38c3248b-0ee1-440d-9b31-0c1018fc7378', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:40:20.028881 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:40:20.029375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:40:20.029791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:40:20.030196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:40:20.030601 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:40:20.039814 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:20.040257 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:20.041045 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:20.041472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:20.058217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Getting quotas for project 129b7faaaf264434baf88ffe0fe9bb25. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:40:20.062139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Getting quotas for user 46fc1f62b79541e7a550731ee4728637 and project 129b7faaaf264434baf88ffe0fe9bb25. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:40:20.073000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:40:20.075314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='380dc3d8-ea9b-4836-b2ea-451270f9150f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:40:20.119707 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-5bc976a0-1181-4dd6-b44e-dbc0746524fa tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483794 Jun 15 10:40:20.120345 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 506/981] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:40:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:40:20.130024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b91a6074-b8d4-40e6-9f8a-43a17e2d8186 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:20.130633 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b91a6074-b8d4-40e6-9f8a-43a17e2d8186 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:20.183191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b91a6074-b8d4-40e6-9f8a-43a17e2d8186 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:20.190640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b91a6074-b8d4-40e6-9f8a-43a17e2d8186 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1219 microversion: 2.1 time: 0.064392 Jun 15 10:40:20.199050 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 476/982] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:20 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:20.309120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:20.309689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:20.317123 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:20.317567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:20.318330 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:20.318762 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:20.456363 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:20.464291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b625e1dc-2279-4955-9728-4ebf3f91cafc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1258 microversion: 2.1 time: 0.159106 Jun 15 10:40:20.464860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 507/983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:20 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:21.207832 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:21.208576 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:21.215581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:21.216540 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:21.217402 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:21.218091 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:21.284409 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:21.288019 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:21.293191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c286d493-1f14-47e0-9518-0de636be3f80 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1271 microversion: 2.1 time: 0.090546 Jun 15 10:40:21.293754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 477/984] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:21 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:21.481698 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:21.482443 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:21.488923 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:21.489378 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:21.490197 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:21.490633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:21.624476 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:21.632745 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b31e4989-6e0a-4b14-b572-01d3d7063c21 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1441 microversion: 2.1 time: 0.155125 Jun 15 10:40:21.633869 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 508/985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:21 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1441 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:21.650596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:21.651621 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:21.659728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:21.660541 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:21.661310 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:21.661897 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:21.832714 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:21.840215 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9276724d-5d0f-420b-8f69-3e6b910f2199 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1441 microversion: 2.1 time: 0.194914 Jun 15 10:40:21.840763 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 478/986] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:21 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1441 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:22.311645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:22.312538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:22.319309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:22.319888 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:22.320759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:22.321301 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:22.544823 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:22.557700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-232df472-10b3-4619-acf1-a9639db1e19c tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.250645 Jun 15 10:40:22.558904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 509/987] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:22 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:23.101085 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-b1c9b8a4-c66d-4ae0-89ab-927931f5d635 req-dd800993-4767-4f39-bafa-d227b1298eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3d8364-1d9b-4bb8-a147-37a0a249a833", "tag": "e5fa316f-d4ae-45f6-8776-e0be02461582"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:23.112583 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-b1c9b8a4-c66d-4ae0-89ab-927931f5d635 req-dd800993-4767-4f39-bafa-d227b1298eb1 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:23.113280 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-b1c9b8a4-c66d-4ae0-89ab-927931f5d635 req-dd800993-4767-4f39-bafa-d227b1298eb1 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:23.138177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-b1c9b8a4-c66d-4ae0-89ab-927931f5d635 req-dd800993-4767-4f39-bafa-d227b1298eb1 service nova] Creating event network-changed:e5fa316f-d4ae-45f6-8776-e0be02461582 for instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 on hv-cinder-84349 Jun 15 10:40:23.144514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-b1c9b8a4-c66d-4ae0-89ab-927931f5d635 req-dd800993-4767-4f39-bafa-d227b1298eb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048634 Jun 15 10:40:23.145131 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 479/988] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:23.575290 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:23.575875 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:23.582992 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:23.583550 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:23.584335 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:23.584777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:23.795860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:23.804228 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aa8a3e07-fb21-49f4-9715-1086683c01cc tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.233005 Jun 15 10:40:23.804995 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 510/989] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:23 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:23.969810 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-8b7d95b4-fe5e-438a-b12c-0f476ae864a1 req-0f9300bc-430f-436e-bc8e-3a284951d5ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:23.978070 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-8b7d95b4-fe5e-438a-b12c-0f476ae864a1 req-0f9300bc-430f-436e-bc8e-3a284951d5ff service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:23.978585 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-8b7d95b4-fe5e-438a-b12c-0f476ae864a1 req-0f9300bc-430f-436e-bc8e-3a284951d5ff service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:23.990092 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-8b7d95b4-fe5e-438a-b12c-0f476ae864a1 req-0f9300bc-430f-436e-bc8e-3a284951d5ff service nova] Creating event network-changed:94642a1a-1e5d-4c38-8e39-fe86241784ed for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e on hv-cinder-84349 Jun 15 10:40:23.994999 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-8b7d95b4-fe5e-438a-b12c-0f476ae864a1 req-0f9300bc-430f-436e-bc8e-3a284951d5ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029745 Jun 15 10:40:23.995681 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 480/990] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:24.821100 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:24.821873 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:24.830126 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:24.830734 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:24.831712 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:24.832260 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:24.850792 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=100 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:24.974313 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:24.982751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-18cd541d-5f32-47ce-86a8-6866212403c5 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.165492 Jun 15 10:40:24.983719 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 511/991] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:24 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:26.001135 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:26.001754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:26.008612 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:26.009062 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:26.009822 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:26.010260 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:26.136549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:26.144639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-043a9401-9bf0-4b54-a53d-a36cf558b470 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.148290 Jun 15 10:40:26.145201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 481/992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:25 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:27.162172 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:27.162703 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:27.169285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:27.169727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:27.170479 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:27.170909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:27.298406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:27.305989 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-80695090-7673-4696-9723-1fcfb6b56a03 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.147722 Jun 15 10:40:27.306549 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 512/993] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:27 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:28.322490 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:28.323122 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:28.329548 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:28.329993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:28.330747 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:28.331200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:28.459517 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:28.466852 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9169414a-a5e1-4dd6-93e1-2e183fe66024 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.148228 Jun 15 10:40:28.467444 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 482/994] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:28 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:29.483831 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:29.485268 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:29.487572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:29.493055 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:29.493499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:29.494253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:29.494684 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:29.631847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:29.639677 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4be02b9c-0c10-4289-9c28-fd53ea070349 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.159613 Jun 15 10:40:29.640364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 513/995] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:29 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:29.818770 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-2e510ebf-d263-4948-8290-e5666ae20a4f req-512ca72c-9700-4bea-99fd-dae2b55b7e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3d8364-1d9b-4bb8-a147-37a0a249a833", "name": "network-vif-plugged", "status": "completed", "tag": "e5fa316f-d4ae-45f6-8776-e0be02461582"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:29.822639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:29.829084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-2e510ebf-d263-4948-8290-e5666ae20a4f req-512ca72c-9700-4bea-99fd-dae2b55b7e1d service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:29.829531 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-2e510ebf-d263-4948-8290-e5666ae20a4f req-512ca72c-9700-4bea-99fd-dae2b55b7e1d service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:29.842133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-2e510ebf-d263-4948-8290-e5666ae20a4f req-512ca72c-9700-4bea-99fd-dae2b55b7e1d service nova] Creating event network-vif-plugged:e5fa316f-d4ae-45f6-8776-e0be02461582 for instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 on hv-cinder-84349 Jun 15 10:40:29.847640 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-2e510ebf-d263-4948-8290-e5666ae20a4f req-512ca72c-9700-4bea-99fd-dae2b55b7e1d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032544 Jun 15 10:40:29.848236 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 483/996] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:30.657058 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:30.657593 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:30.659459 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:30.660152 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=6 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:30.666398 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:30.666845 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:30.667647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:30.668078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:30.794983 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:30.803217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f5162cba-c45e-422e-80ea-ca6ed2694060 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1319 microversion: 2.1 time: 0.150237 Jun 15 10:40:30.803812 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 514/997] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:30 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:31.817322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:31.822001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:31.822692 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:31.829153 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:31.829595 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:31.830342 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:31.830772 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:31.956964 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:31.964503 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2286f892-a28d-4f40-8c01-f5fa5b58b551 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1508 microversion: 2.1 time: 0.148225 Jun 15 10:40:31.965060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 484/998] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:31 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:31.980581 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a0b35d-db5d-4290-b6a2-4ce650ce81f1", "device": "/dev/sdb"}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:31.981654 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:31.988662 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:31.989106 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:31.989865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:31.990298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:32.237700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-112fae08-1f72-4e82-9eb1-88d5b404ede2 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "POST /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260835 Jun 15 10:40:32.239700 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 515/999] 10.222.0.49 () {60 vars in 1322 bytes} [Wed Jun 15 10:40:31 2022] POST /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:40:51.489169 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:51.489654 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:51.492109 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:51.492820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=30 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:51.498606 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:51.499058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:51.499864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:51.500302 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:51.578395 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lazy-loading 'services' on Instance uuid cb3d8364-1d9b-4bb8-a147-37a0a249a833 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:40:51.649125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1ef88781-d63c-43a7-995e-9e9aa7c1146a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833/os-volume_attachments/54a0b35d-db5d-4290-b6a2-4ce650ce81f1" status: 202 len: 0 microversion: 2.1 time: 0.163714 Jun 15 10:40:51.649778 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 485/1000] 10.222.0.49 () {58 vars in 1415 bytes} [Wed Jun 15 10:40:51 2022] DELETE /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833/os-volume_attachments/54a0b35d-db5d-4290-b6a2-4ce650ce81f1 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:40:52.757120 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=5 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:52.757890 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:52.762109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:52.762689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:52.771137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:52.771853 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:52.772617 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:52.773046 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:52.799566 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:40:52.873458 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7d44b46a-a03d-43c6-aa4b-17031f21a9c9 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 204 len: 0 microversion: 2.1 time: 0.117566 Jun 15 10:40:52.874048 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 516/1001] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:40:52 2022] DELETE /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:40:52.884044 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:52.884743 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:52.891117 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:52.891558 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:52.892314 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:52.892754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:53.025665 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:53.033968 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-0ba509d9-0d66-4cd9-a112-b5febb50453a tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1514 microversion: 2.1 time: 0.154859 Jun 15 10:40:53.034777 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 486/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:52 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:40:54.051262 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:54.051955 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:54.058374 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:54.058813 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:54.059586 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:54.060022 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:54.184979 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:54.192504 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ad4a1876-131e-4eb8-85fc-e1971c600a06 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1514 microversion: 2.1 time: 0.145508 Jun 15 10:40:54.193070 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 517/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:54 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:55.210002 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:55.210651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:55.218175 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:55.218628 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:55.219436 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:55.219873 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:55.250253 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-847a2a5a-d66b-4477-b983-d8e99d6c8ace req-432c128d-174e-4c6f-93ee-b4eae7e7bb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3d8364-1d9b-4bb8-a147-37a0a249a833", "name": "network-vif-deleted", "tag": "e5fa316f-d4ae-45f6-8776-e0be02461582"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:40:55.259782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-847a2a5a-d66b-4477-b983-d8e99d6c8ace req-432c128d-174e-4c6f-93ee-b4eae7e7bb98 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:55.260227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-847a2a5a-d66b-4477-b983-d8e99d6c8ace req-432c128d-174e-4c6f-93ee-b4eae7e7bb98 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:55.271830 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-847a2a5a-d66b-4477-b983-d8e99d6c8ace req-432c128d-174e-4c6f-93ee-b4eae7e7bb98 service nova] Creating event network-vif-deleted:e5fa316f-d4ae-45f6-8776-e0be02461582 for instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 on hv-cinder-84349 Jun 15 10:40:55.276801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-847a2a5a-d66b-4477-b983-d8e99d6c8ace req-432c128d-174e-4c6f-93ee-b4eae7e7bb98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030181 Jun 15 10:40:55.277398 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 518/1004] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:40:55.296061 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46fc1f62b79541e7a550731ee4728637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '129b7faaaf264434baf88ffe0fe9bb25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:40:55.304555 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e6de41bf-a324-4e53-8fb2-5247d9a9850b tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 200 len: 1472 microversion: 2.1 time: 0.098661 Jun 15 10:40:55.305118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 487/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:55 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 1472 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:40:56.322865 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:40:56.323594 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] [instance: cb3d8364-1d9b-4bb8-a147-37a0a249a833] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:40:56.329897 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:56.330353 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:56.331161 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:40:56.331599 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:40:56.344614 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] HTTP exception thrown: Instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 could not be found. Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Request method failure captured: Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 HTTP/1.1 Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbbI-BCc1xkGv_-EBpQdm_Div8ShnF-t6RTgDGcuBM_2gX0NRH-Djmh_i3l9VQtLZTywWFSQXxsHVhtoA6dqQODbDji40mS-2Pap9wla-iYtBXfZZgV6eFqBkTRHb7RAX4fYkvB00yeCYTUwOkntvGr2pTZkFw7zyBPnP971IMbHhCo Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: 129b7faaaf264434baf88ffe0fe9bb25 Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-377415052 Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:40:56.346254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/129b7faaaf264434baf88ffe0fe9bb25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-VolumesSnapshotTestJSON-377415052 Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: 129b7faaaf264434baf88ffe0fe9bb25 Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-377415052 Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-VolumesSnapshotTestJSON-377415052-project Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 46fc1f62b79541e7a550731ee4728637 Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-VolumesSnapshotTestJSON-377415052-project Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 could not be found. Jun 15 10:40:56.347838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': 'cb3d8364-1d9b-4bb8-a147-37a0a249a833'} Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 could not be found. Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:40:56.348728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 could not be found. Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 could not be found. Jun 15 10:40:56.350373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:40:56.351791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] Returning 404 to user: Instance cb3d8364-1d9b-4bb8-a147-37a0a249a833 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:40:56.351791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-d8747ad5-31c3-4379-bcc7-d2c29d198d53 tempest-VolumesSnapshotTestJSON-377415052 tempest-VolumesSnapshotTestJSON-377415052-project] 10.222.0.49 "GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833" status: 404 len: 111 microversion: 2.1 time: 0.029549 Jun 15 10:40:56.351791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 519/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:40:56 2022] GET /compute/v2.1/servers/cb3d8364-1d9b-4bb8-a147-37a0a249a833 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:41:36.487632 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:41:36.488281 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Wed Jun 15 10:41:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:41:44.962393 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:44.962959 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:44.965178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:44.965840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:44.971705 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:44.972147 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:44.973546 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:44.973972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:44.998754 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:41:45.072880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c8ebe296-651a-4c0a-b55c-0a72695e1935 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 204 len: 0 microversion: 2.1 time: 0.113831 Jun 15 10:41:45.073643 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 488/1007] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:41:44 2022] DELETE /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:41:45.082449 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:45.083250 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:45.085354 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:45.086026 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:45.092512 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:45.092956 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:45.093718 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:45.094148 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:45.382648 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:45.390137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-c945eb9a-6a8f-4891-8fd4-999b1f2a9749 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1574 microversion: 2.1 time: 0.312525 Jun 15 10:41:45.390723 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 520/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:45 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1574 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:46.408805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:46.409515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:46.416638 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.417082 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.417835 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:46.418259 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:46.604332 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:46.611871 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4c2bccbb-956d-40b9-a4ba-4181ed8ffa25 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1574 microversion: 2.1 time: 0.207390 Jun 15 10:41:46.612416 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 489/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:46 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:47.628766 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:47.629375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:47.636645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:47.637091 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:47.637846 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:47.638277 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:47.702413 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:47.710084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-844fdac0-a20d-4bc8-adea-f621fa7f23f2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1508 microversion: 2.1 time: 0.085239 Jun 15 10:41:47.710732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 521/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:47 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1508 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:47.916937 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-5a36f4be-823a-4676-b3bf-92a46e3ff044 req-a4d297f7-963d-4448-8aab-bded2dd64a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2626cd15-7eaf-42ac-adce-e523831ee0c7", "name": "network-vif-deleted", "tag": "e167a1a5-8acd-4587-800d-75d04b74e52e"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:41:47.928380 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-5a36f4be-823a-4676-b3bf-92a46e3ff044 req-a4d297f7-963d-4448-8aab-bded2dd64a40 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:47.931301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-5a36f4be-823a-4676-b3bf-92a46e3ff044 req-a4d297f7-963d-4448-8aab-bded2dd64a40 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:47.949589 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-5a36f4be-823a-4676-b3bf-92a46e3ff044 req-a4d297f7-963d-4448-8aab-bded2dd64a40 service nova] Creating event network-vif-deleted:e167a1a5-8acd-4587-800d-75d04b74e52e for instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 on hv-cinder-84349 Jun 15 10:41:47.954992 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-5a36f4be-823a-4676-b3bf-92a46e3ff044 req-a4d297f7-963d-4448-8aab-bded2dd64a40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104457 Jun 15 10:41:47.955637 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 490/1011] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:41:48.727217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:48.728025 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:48.734664 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:48.735261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:48.736161 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:48.736728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:48.773187 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:48.773968 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:48.774427 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lazy-loading 'fault' on Instance uuid 2626cd15-7eaf-42ac-adce-e523831ee0c7 {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:41:48.822635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:48.829906 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-a630ae62-1056-431c-9d6c-ca5ce171e164 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 200 len: 1184 microversion: 2.1 time: 0.107104 Jun 15 10:41:48.830485 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 522/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:48 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 1184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:49.847971 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:49.848709 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:49.854970 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:49.855445 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:49.856193 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:49.856654 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:49.870139 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] HTTP exception thrown: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Request method failure captured: Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 HTTP/1.1 Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqba0Dv-YHkugaAJk__5NTv1ymhZ1SRwd-U7UHKovip0TblvQlc4OqSLybfqxdbihXPO_zSYDU7SUi61B5gM4xTDy8ZlMLNh02HQkrHeXNMA885kdnn5y_Re4doJy1R7hQxlDmuSkc6_KO6w5amdEp_BJPYhgxGD8IHgqVvEsz06DJ8Q Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:41:49.871752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 61bc9ad2c9444fc297eb4b5902a67b98 Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:41:49.873437 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '2626cd15-7eaf-42ac-adce-e523831ee0c7'} Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:41:49.874478 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:41:49.876150 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:41:49.877596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Returning 404 to user: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:41:49.877596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b5fc8be6-65dd-4cad-870f-45e3108250d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 404 len: 111 microversion: 2.1 time: 0.030043 Jun 15 10:41:49.877596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 491/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:49 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:41:49.968451 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-296937685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2010066906", "security_groups": [{"name": "tempest-secgroup-smoke-52272593"}], "block_device_mapping_v2": [{"uuid": "8c965996-65d0-4a87-9782-dcf9e411b7cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "104a1ab4-a947-4523-8e20-9882108d1335"}]}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:41:50.079187 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.network.neutron [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] validate_networks() for [('104a1ab4-a947-4523-8e20-9882108d1335', None, None, None, None, None)] {{(pid=118864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:41:50.491305 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Flavor limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:41:50.491724 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Image limits 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:41:50.492246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Flavor pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:41:50.492636 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Image pref 0:0:0 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:41:50.493041 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.virt.hardware [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:41:50.501829 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:50.502273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:50.503056 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:50.503515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:50.519828 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:41:50.524074 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.quota [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for user 61bc9ad2c9444fc297eb4b5902a67b98 and project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'cores', 'ram', 'instances'} {{(pid=118864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:41:50.580001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Going to run 1 instances... {{(pid=118864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:41:50.582106 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c965996-65d0-4a87-9782-dcf9e411b7cb',volume_size=None,volume_type=None)] {{(pid=118864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:41:50.706683 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-61de5aaf-de34-4fff-b432-460ed7d52dcb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.742061 Jun 15 10:41:50.707358 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 523/1014] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:41:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:41:50.717753 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4a588688-0018-41fa-8974-69992877f8a0 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:50.718365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4a588688-0018-41fa-8974-69992877f8a0 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:50.772597 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4a588688-0018-41fa-8974-69992877f8a0 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:50.779703 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4a588688-0018-41fa-8974-69992877f8a0 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1094 microversion: 2.1 time: 0.065790 Jun 15 10:41:50.780262 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 492/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:50 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:51.799200 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:51.799850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:51.808292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:51.808753 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:51.809530 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:51.809971 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:51.885561 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:51.895782 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-692e7938-2674-45f7-a97f-4377e3998070 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1200 microversion: 2.1 time: 0.101706 Jun 15 10:41:51.903130 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 524/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:51 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:52.913794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:52.914404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:52.921716 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:52.922156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:52.922913 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:52.923370 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:53.138920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:53.148200 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-f0dbb4c9-0d4e-46b6-9354-f180f3c668e4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.238284 Jun 15 10:41:53.149084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 493/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:52 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:53.343152 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-1e384bd0-e606-4d59-a387-07ff793ec7a9 req-300e7036-77da-40e8-8fba-1939c30d3b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124aa8d6-54b1-4c24-821b-e022b8752904", "tag": "27606219-e918-4e9a-aa30-81725e2a94e1"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:41:53.352447 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-1e384bd0-e606-4d59-a387-07ff793ec7a9 req-300e7036-77da-40e8-8fba-1939c30d3b3c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:53.352893 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-1e384bd0-e606-4d59-a387-07ff793ec7a9 req-300e7036-77da-40e8-8fba-1939c30d3b3c service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:53.366495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-1e384bd0-e606-4d59-a387-07ff793ec7a9 req-300e7036-77da-40e8-8fba-1939c30d3b3c service nova] Creating event network-changed:27606219-e918-4e9a-aa30-81725e2a94e1 for instance 124aa8d6-54b1-4c24-821b-e022b8752904 on hv-cinder-84349 Jun 15 10:41:53.371708 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-1e384bd0-e606-4d59-a387-07ff793ec7a9 req-300e7036-77da-40e8-8fba-1939c30d3b3c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 Jun 15 10:41:53.372316 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 525/1018] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:41:54.165890 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:54.166519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:54.173206 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:54.173651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:54.174416 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:54.174849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:54.401001 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:54.408426 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7774d6ac-d00b-4c3e-a7ba-594f31589feb tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.246987 Jun 15 10:41:54.408978 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 494/1019] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:54 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:55.426357 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:55.427065 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:55.433324 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:55.433769 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:55.434527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:55.434961 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:55.566086 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:55.574155 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f9551a3f-9434-4479-a460-05dd3aa2d88d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.152475 Jun 15 10:41:55.574720 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 526/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:55 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:56.590908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:56.591538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:56.598102 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:56.598547 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:56.599323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:56.600381 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:56.729559 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:56.736914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-1d7a2eef-614f-40d7-a123-843ad5a1220a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.149915 Jun 15 10:41:56.737470 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 495/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:56 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:57.752633 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:57.753234 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:57.760324 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:57.760766 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:57.761517 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:57.761947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:57.893102 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:57.901464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-b5ebf682-2d52-4d87-80c9-2b003d369a06 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.152712 Jun 15 10:41:57.902028 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 527/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:57 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:41:58.917651 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:41:58.918281 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:41:58.924494 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:58.924936 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:58.925686 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:41:58.926115 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:41:59.053004 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:41:59.060393 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-53085cda-9419-42a6-aabe-a9d047007be4 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.146571 Jun 15 10:41:59.060943 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 496/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:41:58 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:00.077689 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:00.078352 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:00.084944 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:00.085390 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:00.086150 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:00.086585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:00.212779 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:00.220413 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f45851aa-5174-433c-bcfa-7aa3bde28b20 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.146626 Jun 15 10:42:00.220970 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 528/1024] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:00 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:01.237439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:01.238049 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:01.241241 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:01.246614 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:01.247058 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:01.248098 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:01.248538 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:01.378848 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:01.386928 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-d0e99d3a-f629-49f2-9389-de77f65ee988 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.153346 Jun 15 10:42:01.387515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 497/1025] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:01 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:02.404089 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:02.404627 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:02.406567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:02.407266 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=6 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:02.413463 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:02.413907 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:02.414657 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:02.415106 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:02.548025 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:02.556233 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-129b75fe-a6c1-4d2d-97f4-627c2aa7fae2 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.156149 Jun 15 10:42:02.556802 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 529/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:02 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:03.572850 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:03.573462 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:03.580006 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:03.580457 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:03.581210 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:03.581645 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:03.710386 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:03.717861 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-04e2538a-2f17-4b28-a025-b5d597536217 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.148898 Jun 15 10:42:03.718446 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 498/1027] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:03 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:04.170715 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-96305f15-ee41-4f69-9345-548f6d31dae7 req-04f37a9d-aae8-4310-a5db-a60b4f2a4ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124aa8d6-54b1-4c24-821b-e022b8752904", "name": "network-vif-plugged", "status": "completed", "tag": "27606219-e918-4e9a-aa30-81725e2a94e1"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:42:04.179298 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-96305f15-ee41-4f69-9345-548f6d31dae7 req-04f37a9d-aae8-4310-a5db-a60b4f2a4ab8 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:04.179738 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-96305f15-ee41-4f69-9345-548f6d31dae7 req-04f37a9d-aae8-4310-a5db-a60b4f2a4ab8 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:04.191166 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-96305f15-ee41-4f69-9345-548f6d31dae7 req-04f37a9d-aae8-4310-a5db-a60b4f2a4ab8 service nova] Creating event network-vif-plugged:27606219-e918-4e9a-aa30-81725e2a94e1 for instance 124aa8d6-54b1-4c24-821b-e022b8752904 on hv-cinder-84349 Jun 15 10:42:04.196722 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-96305f15-ee41-4f69-9345-548f6d31dae7 req-04f37a9d-aae8-4310-a5db-a60b4f2a4ab8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089108 Jun 15 10:42:04.197597 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 530/1028] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:42:04.734434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:04.734963 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:04.742156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:04.742602 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:04.743390 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:04.743833 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:04.871908 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:04.879330 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-521f4c80-088d-4526-86c1-6a0fe0ded0bd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.148811 Jun 15 10:42:04.879909 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 499/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:04 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:05.897680 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:05.898388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:05.904717 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:05.905172 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:05.905941 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:05.906376 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:06.038618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:06.046893 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e5b50feb-fc9e-43ae-9a0b-8715fc7bda1a tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1264 microversion: 2.1 time: 0.154325 Jun 15 10:42:06.047492 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 531/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:05 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:07.064949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:07.065519 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:07.072725 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:07.073178 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:07.073945 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:07.074383 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:07.199949 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:07.207526 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-8984c7cb-78c8-4390-9803-a8c156d097fd tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1449 microversion: 2.1 time: 0.146552 Jun 15 10:42:07.208084 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 500/1031] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:07 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1449 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:07.223415 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:07.224026 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:07.230550 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:07.230995 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:07.231788 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:07.232221 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:07.363263 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:07.371382 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9866adeb-cac9-4d65-9041-d62593624c9e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1449 microversion: 2.1 time: 0.151892 Jun 15 10:42:07.371940 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 532/1032] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:07 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:09.152094 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-74ec6dff-18e1-4ebb-9c5c-48f77f6a934d req-4272a671-6609-48b3-b97a-65a38c4252ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124aa8d6-54b1-4c24-821b-e022b8752904", "tag": "27606219-e918-4e9a-aa30-81725e2a94e1"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:42:09.160439 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-74ec6dff-18e1-4ebb-9c5c-48f77f6a934d req-4272a671-6609-48b3-b97a-65a38c4252ab service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:09.160890 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-74ec6dff-18e1-4ebb-9c5c-48f77f6a934d req-4272a671-6609-48b3-b97a-65a38c4252ab service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:09.172140 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-74ec6dff-18e1-4ebb-9c5c-48f77f6a934d req-4272a671-6609-48b3-b97a-65a38c4252ab service nova] Creating event network-changed:27606219-e918-4e9a-aa30-81725e2a94e1 for instance 124aa8d6-54b1-4c24-821b-e022b8752904 on hv-cinder-84349 Jun 15 10:42:09.177803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-74ec6dff-18e1-4ebb-9c5c-48f77f6a934d req-4272a671-6609-48b3-b97a-65a38c4252ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028700 Jun 15 10:42:09.178434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 501/1033] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:42:29.618271 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:42:29.618860 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:29.620943 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:29.621587 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=68 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:29.627381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:29.627826 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:29.628578 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:29.629007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:29.653080 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.objects.instance [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lazy-loading 'flavor' on Instance uuid 4f6bfe90-7d7f-4905-b097-81c9bda21a3e {{(pid=118864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:42:29.722499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-248a9a77-fbd6-4349-bc5d-3d05d7c29d67 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "POST /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.108027 Jun 15 10:42:29.723244 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 533/1034] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:42:29 2022] POST /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:42:29.732160 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:29.733404 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:29.740526 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:29.741814 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:29.751714 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:29.752166 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:29.752933 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:29.753367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:29.885807 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:29.893328 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-87c982a9-be28-4380-b29e-0cc456b8aab4 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.164286 Jun 15 10:42:29.893889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 502/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:29 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:30.911801 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:30.912496 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:30.919640 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:30.920078 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:30.920833 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:30.921263 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:31.051114 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:31.058718 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-fe5948e7-e131-41cd-aa1e-76b1e29c5861 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.151211 Jun 15 10:42:31.059307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 534/1036] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:30 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:32.076235 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:32.076840 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:32.083346 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:32.083789 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:32.084536 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:32.085456 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:32.216628 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:32.224528 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-fe41b263-c4a1-456d-a242-708fa2a0cc6d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.152187 Jun 15 10:42:32.225078 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 503/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:32 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:33.241777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:33.242392 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:33.249047 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:33.249499 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:33.250267 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:33.250706 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:33.380488 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:33.388647 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-0282e999-5927-4777-9c67-c981155f5613 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.151265 Jun 15 10:42:33.389210 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 535/1038] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:33 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:34.405617 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:34.406224 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:34.412799 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:34.413246 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:34.414002 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:34.414434 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:34.540552 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:34.548073 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a98809ca-6e49-4597-8c42-2aef470cb622 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.146280 Jun 15 10:42:34.548626 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 504/1039] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:34 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:35.565477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:35.566080 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:35.572566 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:35.573012 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:35.573760 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:35.574195 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:35.703510 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:35.711538 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-be58b29c-4394-40ea-a808-a9bf123297d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.149971 Jun 15 10:42:35.712093 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 536/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:35 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:36.729380 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:36.730014 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:36.736464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:36.736905 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:36.737646 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:36.738077 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:36.869794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:36.877272 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-36d8b54b-669b-490d-b210-3673916aaf12 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.152237 Jun 15 10:42:36.877826 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 505/1041] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:36 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:37.894092 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:37.894991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:37.901909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:37.902356 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:37.903141 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:37.903575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:38.030238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:38.037740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7f2bda01-eada-4920-80d5-4d26a59ba92e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.147566 Jun 15 10:42:38.038300 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 537/1042] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:37 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:39.055769 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:39.056323 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:39.062728 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:39.063201 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:39.063957 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:39.064388 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:39.191410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:39.198936 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-77d4f869-2e12-429e-b4cd-f321c44de018 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.147680 Jun 15 10:42:39.199515 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 506/1043] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:39 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:40.215839 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:40.216453 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:40.222989 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:40.223472 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:40.224239 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:40.224672 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:40.356794 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:40.364637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-45147adb-c1f6-4d8c-ab95-58eff6b14271 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.152620 Jun 15 10:42:40.365199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 538/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:40 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:41.381422 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:41.382027 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:41.388650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:41.389090 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:41.389837 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:41.390266 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:41.517483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:41.525133 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-5ec631e6-2f80-42e8-b901-7fc292d9a894 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.147581 Jun 15 10:42:41.525685 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 507/1045] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:41 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:42.542218 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:42.542851 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:42.549292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:42.549732 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:42.550478 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:42.550904 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:42.678086 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:42.686087 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-92c441dc-b355-452b-9293-ed5f06d5866d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.148047 Jun 15 10:42:42.686649 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 539/1046] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:42 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:42.849977 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:42:42.850539 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Wed Jun 15 10:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:42:43.703198 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:43.703797 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:43.710926 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:43.711397 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:43.712156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:43.712588 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:43.844616 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:43.853072 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-47d6c9bc-09a1-47d3-9670-ec325b8d8006 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1506 microversion: 2.1 time: 0.153729 Jun 15 10:42:43.853644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 508/1047] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:43 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:43.869349 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:42:43.869917 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:43.876404 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:43.876843 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:43.877591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:43.878019 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:43.951224 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-82f3bdce-1ef9-4eaf-bfd6-de92fe3b5296 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "POST /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e/action" status: 202 len: 0 microversion: 2.1 time: 0.085601 Jun 15 10:42:43.951745 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 540/1048] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Jun 15 10:42:43 2022] POST /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:42:43.959882 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:43.960920 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:43.966793 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:43.967294 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:43.968055 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:43.968489 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:44.098488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:44.106667 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-b34f9d99-3662-432a-8a40-7ae313cccb40 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1514 microversion: 2.1 time: 0.150671 Jun 15 10:42:44.107235 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 509/1049] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:43 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:45.123676 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:45.124285 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:45.131121 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:45.131658 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:45.132847 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:45.133292 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:45.291360 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:45.298980 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4f20ab5c-9140-4d78-a9ad-082ecc9401fc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1514 microversion: 2.1 time: 0.179605 Jun 15 10:42:45.299577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 541/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:45 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:46.316199 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:46.316811 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:46.320297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-74183c62-1e42-4113-8d31-e7ee12a6ed20 req-eca625e7-bad7-44d4-8e56-31c37931333e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "name": "network-vif-unplugged", "status": "completed", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:42:46.324392 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:46.324599 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:46.325581 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:46.326180 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:46.330899 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-74183c62-1e42-4113-8d31-e7ee12a6ed20 req-eca625e7-bad7-44d4-8e56-31c37931333e service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:46.331728 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-74183c62-1e42-4113-8d31-e7ee12a6ed20 req-eca625e7-bad7-44d4-8e56-31c37931333e service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:46.346568 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.compute.server_external_events [req-74183c62-1e42-4113-8d31-e7ee12a6ed20 req-eca625e7-bad7-44d4-8e56-31c37931333e service nova] Unable to find a host for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e. Dropping event network-vif-unplugged {{(pid=118864) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 10:42:46.347855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-74183c62-1e42-4113-8d31-e7ee12a6ed20 req-eca625e7-bad7-44d4-8e56-31c37931333e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032740 Jun 15 10:42:46.349373 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 542/1051] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 10:42:46.468636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:46.477275 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-c9ccb262-9aa8-48e7-a94d-5d17d52b76f2 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1514 microversion: 2.1 time: 0.164923 Jun 15 10:42:46.477820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 510/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:46 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:47.493991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:47.494606 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:47.501146 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:47.501593 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:47.502364 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:47.502798 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:47.633960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:47.641449 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-7c5d8e70-b910-4115-b0e2-eebe0c55fbf7 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1514 microversion: 2.1 time: 0.151853 Jun 15 10:42:47.642014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 543/1053] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:47 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:48.657517 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:48.658120 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:48.665497 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:48.666012 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:48.666935 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:48.667383 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:48.799179 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:48.806687 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7f91d598-857e-4a0c-b757-eecaa18f473c tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1516 microversion: 2.1 time: 0.152943 Jun 15 10:42:48.807261 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 511/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:48 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:49.824620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:49.825254 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:49.831894 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:49.832340 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:49.833101 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:49.833537 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:49.964481 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:49.972060 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aabb7ae2-990f-4d83-b865-eec3b9315f6e tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.151486 Jun 15 10:42:49.972623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 544/1055] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:49 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:50.989376 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:50.989982 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:50.997060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:50.997504 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:50.998254 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:50.998678 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:51.134600 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:51.142044 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-144f6380-29db-4afc-993e-3d89fab660d5 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.156509 Jun 15 10:42:51.142596 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 512/1056] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:50 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:52.159884 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:52.160430 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:52.167466 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:52.167919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:52.168675 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:52.169106 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:52.294524 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:52.302033 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-2197c489-d624-4372-8ba7-5abe7a646516 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.146137 Jun 15 10:42:52.302602 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 545/1057] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:52 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:53.318518 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:53.319638 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:53.326349 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:53.326740 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:53.327529 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:53.327966 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:53.455046 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:53.463079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a3225381-fa3d-4472-adf5-6455e63b1283 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.148440 Jun 15 10:42:53.463857 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 513/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:53 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:54.480855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:54.481383 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:54.487931 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:54.488380 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:54.489137 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:54.489573 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:54.620909 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:54.628432 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dcf34970-8409-400b-a1a9-37ce60e00cbf tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.151573 Jun 15 10:42:54.628990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 546/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:54 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:42:55.645322 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:55.645946 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:55.652424 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:55.652863 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:55.653611 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:55.654037 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:55.787423 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:55.795726 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-39e7c356-e317-496e-bf5f-f8a9a17e9c70 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.154496 Jun 15 10:42:55.796289 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 514/1060] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:55 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:56.812667 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:56.813273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:56.819808 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:56.820249 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:56.820998 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:56.821425 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:56.825506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:56.951109 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:56.958567 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-cff0b533-20d3-41c2-a980-5714d4eec078 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.149843 Jun 15 10:42:56.959139 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 547/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:56 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:57.976436 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:57.977068 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:57.983483 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:57.983930 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:57.984695 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:57.985125 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:58.111609 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:58.119158 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-57be4659-f1bc-428e-8b74-c98ed4732a5f tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.147116 Jun 15 10:42:58.119711 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 515/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:57 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:42:59.136354 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:42:59.136957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:42:59.143403 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:59.144097 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:59.144842 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:42:59.145269 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:42:59.277379 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:42:59.284751 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-aa6d3770-8c56-4058-8213-f90cb0b575af tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.152250 Jun 15 10:42:59.285309 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 548/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:42:59 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:00.301498 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:00.302110 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:00.304808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=29 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:00.310280 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:00.310730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:00.311553 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:00.311986 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:00.316321 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=85 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:00.428941 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-f5e57bbb-bea0-4273-a4cf-8eae426e5c0f req-0de23496-4f0b-48a4-a3c3-05e59a1d1e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "name": "network-vif-plugged", "status": "completed", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:43:00.434462 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=35 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:00.438630 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-f5e57bbb-bea0-4273-a4cf-8eae426e5c0f req-0de23496-4f0b-48a4-a3c3-05e59a1d1e38 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:00.439032 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-f5e57bbb-bea0-4273-a4cf-8eae426e5c0f req-0de23496-4f0b-48a4-a3c3-05e59a1d1e38 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:00.442113 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:00.450412 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-9699a2e8-de01-47c9-ba36-bede437c8e03 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.152692 Jun 15 10:43:00.451157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 516/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:00 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:00.452914 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-f5e57bbb-bea0-4273-a4cf-8eae426e5c0f req-0de23496-4f0b-48a4-a3c3-05e59a1d1e38 service nova] Creating event network-vif-plugged:94642a1a-1e5d-4c38-8e39-fe86241784ed for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e on hv-cinder-84349 Jun 15 10:43:00.458083 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-f5e57bbb-bea0-4273-a4cf-8eae426e5c0f req-0de23496-4f0b-48a4-a3c3-05e59a1d1e38 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Jun 15 10:43:00.458928 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 549/1065] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:43:01.467023 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:01.467689 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:01.474157 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:01.474603 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:01.475903 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:01.476337 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:01.602722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:01.610165 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-4bd8553e-e5c2-453f-b6fe-3c2f4624f541 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1572 microversion: 2.1 time: 0.146964 Jun 15 10:43:01.610724 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 517/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:01 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:02.630673 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:02.631506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:02.638173 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:02.638626 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:02.639406 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:02.639839 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:02.772397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:02.779994 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-58b9558a-8b1b-42a0-8b6c-3db9b866c11d tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1559 microversion: 2.1 time: 0.154121 Jun 15 10:43:02.780553 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 550/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:02 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:07.719031 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:43:07.719601 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Wed Jun 15 10:43:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:43:45.102636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-968428976", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2010066906", "security_groups": [{"name": "tempest-secgroup-smoke-52272593"}], "block_device_mapping_v2": [{"uuid": "e90df823-982a-46b9-b84f-33b0ff8c6473", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "104a1ab4-a947-4523-8e20-9882108d1335"}]}} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:43:45.110794 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:45.111636 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=11 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:45.218270 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.network.neutron [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] validate_networks() for [('104a1ab4-a947-4523-8e20-9882108d1335', None, None, None, None, None)] {{(pid=118865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 10:43:45.588343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Flavor limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 10:43:45.588760 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Image limits 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 10:43:45.589224 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Flavor pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 10:43:45.589625 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Image pref 0:0:0 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 10:43:45.590026 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.virt.hardware [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 10:43:45.599060 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:45.599526 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:45.600306 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:45.600730 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:45.617365 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 10:43:45.621789 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.quota [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Getting quotas for user 61bc9ad2c9444fc297eb4b5902a67b98 and project f096e399deac4d029ff63e3cb7f1ce9f. Resources: {'cores', 'ram', 'instances'} {{(pid=118865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 10:43:45.676987 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Going to run 1 instances... {{(pid=118865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 10:43:45.679081 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e90df823-982a-46b9-b84f-33b0ff8c6473',volume_size=None,volume_type=None)] {{(pid=118865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 10:43:45.809177 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-2af90637-57f0-42eb-89f8-27a84e2769a6 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.710319 Jun 15 10:43:45.809816 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 518/1068] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Jun 15 10:43:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 10:43:45.819615 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ada9ca4c-b1d6-4bf9-8683-337275c964f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:45.820227 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ada9ca4c-b1d6-4bf9-8683-337275c964f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:45.822495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=3 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:45.823771 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=18 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:45.875477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ada9ca4c-b1d6-4bf9-8683-337275c964f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:45.882893 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ada9ca4c-b1d6-4bf9-8683-337275c964f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1094 microversion: 2.1 time: 0.066730 Jun 15 10:43:45.883513 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 551/1069] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:45 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:46.899752 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:46.900367 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:46.908696 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:46.909144 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:46.910348 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:46.910895 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:46.984763 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:46.992245 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-cb3a5a61-52da-4287-9b0c-2fff915f8530 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1210 microversion: 2.1 time: 0.096470 Jun 15 10:43:46.992804 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 519/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:46 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:43:48.011635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:48.012307 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:48.018895 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:48.019397 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:48.020159 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:48.020768 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:48.157495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:48.164991 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9dd944e4-6ba5-4acf-a0cd-14060ba28885 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.159002 Jun 15 10:43:48.165559 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 552/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:48 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:48.503783 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-9e93943c-c232-4bde-af6f-0b23065579d0 req-1a3bbcb3-43be-4f93-a916-837cf8b20117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871b2448-1f70-4437-bcac-c8e716de5346", "tag": "0309f496-3d06-4f10-bdab-52c6d3f15d88"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:43:48.524562 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-9e93943c-c232-4bde-af6f-0b23065579d0 req-1a3bbcb3-43be-4f93-a916-837cf8b20117 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:48.525048 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-9e93943c-c232-4bde-af6f-0b23065579d0 req-1a3bbcb3-43be-4f93-a916-837cf8b20117 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:48.536785 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-9e93943c-c232-4bde-af6f-0b23065579d0 req-1a3bbcb3-43be-4f93-a916-837cf8b20117 service nova] Creating event network-changed:0309f496-3d06-4f10-bdab-52c6d3f15d88 for instance 871b2448-1f70-4437-bcac-c8e716de5346 on hv-cinder-84349 Jun 15 10:43:48.542410 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-9e93943c-c232-4bde-af6f-0b23065579d0 req-1a3bbcb3-43be-4f93-a916-837cf8b20117 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053064 Jun 15 10:43:48.543118 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 520/1072] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:43:49.181755 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:49.182362 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:49.188864 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:49.189314 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:49.190071 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:49.190506 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:49.317855 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:49.325821 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f359a8a7-1101-40c7-8730-317eded40713 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.148015 Jun 15 10:43:49.326381 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 553/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:49 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:50.343241 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:50.343942 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:50.350181 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:50.350627 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:50.351413 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:50.351849 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:50.480248 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:50.488464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-368b1cfe-2f13-4508-a47f-5cf45976a315 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.150385 Jun 15 10:43:50.489234 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 521/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:50 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:51.505893 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:51.506490 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:51.512759 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:51.513211 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:51.513995 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:51.514431 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:51.642230 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:51.649856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-93c949f3-b576-432a-9ab8-7d1f1953476d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.147988 Jun 15 10:43:51.650414 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 554/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:51 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:52.666610 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:52.667276 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:52.674334 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:52.674782 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:52.675561 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:52.675993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:52.806472 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:52.814469 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-56c7726d-0486-41e7-a76d-e223ec17b57d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.151807 Jun 15 10:43:52.815024 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 522/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:52 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:53.919358 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:53.919966 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:53.925933 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:53.926377 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:53.927157 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:53.927591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:54.053836 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:54.061882 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-077a9de0-4fde-4bc7-b0f4-f458f63b3390 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.234749 Jun 15 10:43:54.062446 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 555/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:53 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:55.078634 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:55.079196 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:55.085735 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:55.086182 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:55.086934 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:55.087401 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:55.217263 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:55.224699 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6dba9781-2a59-4ab5-b7f1-3ccfe257a669 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.150064 Jun 15 10:43:55.225243 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 523/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:55 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:56.240469 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:56.241119 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:56.243577 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell0:SELECT=2 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:56.249018 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:56.249464 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:56.250229 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:56.250665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:56.377763 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:56.386388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e76fbef1-5ec0-486d-be4e-e7fca2ae12f9 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.149735 Jun 15 10:43:56.387417 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 556/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:56 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:57.404435 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:57.405036 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:57.406970 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=2 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:57.407781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell0:SELECT=6 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:57.413906 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:57.414350 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:57.415123 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:57.415554 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:57.544405 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:57.551880 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-3a70eb61-029e-44e7-b2a9-6a10df8e0990 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.151828 Jun 15 10:43:57.552429 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 524/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:57 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:58.568507 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:58.569181 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:58.576085 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:58.576620 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:58.577628 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:58.578065 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:58.658431 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-cef4c470-4d85-48e1-83b0-4ddc7e14d480 req-60b64383-b47b-48c7-a4bb-419dfae3ad68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871b2448-1f70-4437-bcac-c8e716de5346", "name": "network-vif-plugged", "status": "completed", "tag": "0309f496-3d06-4f10-bdab-52c6d3f15d88"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:43:58.668176 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-cef4c470-4d85-48e1-83b0-4ddc7e14d480 req-60b64383-b47b-48c7-a4bb-419dfae3ad68 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:58.668622 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-cef4c470-4d85-48e1-83b0-4ddc7e14d480 req-60b64383-b47b-48c7-a4bb-419dfae3ad68 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:58.680937 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-cef4c470-4d85-48e1-83b0-4ddc7e14d480 req-60b64383-b47b-48c7-a4bb-419dfae3ad68 service nova] Creating event network-vif-plugged:0309f496-3d06-4f10-bdab-52c6d3f15d88 for instance 871b2448-1f70-4437-bcac-c8e716de5346 on hv-cinder-84349 Jun 15 10:43:58.686979 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-cef4c470-4d85-48e1-83b0-4ddc7e14d480 req-60b64383-b47b-48c7-a4bb-419dfae3ad68 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032543 Jun 15 10:43:58.688225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 525/1081] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:43:58.715838 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:58.725004 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-20c5e79c-c5a3-47ab-a92d-aa8608a8e35d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.160479 Jun 15 10:43:58.725583 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 557/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:58 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:43:59.743523 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:43:59.744909 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:43:59.751111 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:59.751568 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:59.752325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:43:59.752761 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:43:59.886336 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:43:59.894170 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e50ef158-e891-44ec-818d-d362fb3c185e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1264 microversion: 2.1 time: 0.155403 Jun 15 10:43:59.894720 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 526/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:43:59 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:44:00.911014 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:00.911682 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:00.918291 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:00.918744 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:00.919542 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:00.919984 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:01.047986 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:44:01.055497 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-ffbbf102-32ae-4a8a-86cf-5249fb05e77f tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1449 microversion: 2.1 time: 0.148368 Jun 15 10:44:01.056087 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 558/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:44:00 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:44:01.071691 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:01.072862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:01.079298 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:01.079741 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:01.080488 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:01.080915 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:01.215820 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:44:01.223305 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-e412a09f-f7f3-4e62-adf5-93614ee3395c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1449 microversion: 2.1 time: 0.155330 Jun 15 10:44:01.223864 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 527/1085] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:44:01 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:44:02.734029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-ffe89584-9eed-4be2-90ad-fc076b0d4c7e req-6e0ad762-c868-42e0-80b0-e5b1164bba97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871b2448-1f70-4437-bcac-c8e716de5346", "tag": "0309f496-3d06-4f10-bdab-52c6d3f15d88"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:44:02.743079 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-ffe89584-9eed-4be2-90ad-fc076b0d4c7e req-6e0ad762-c868-42e0-80b0-e5b1164bba97 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:02.743644 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-ffe89584-9eed-4be2-90ad-fc076b0d4c7e req-6e0ad762-c868-42e0-80b0-e5b1164bba97 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:02.756075 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-ffe89584-9eed-4be2-90ad-fc076b0d4c7e req-6e0ad762-c868-42e0-80b0-e5b1164bba97 service nova] Creating event network-changed:0309f496-3d06-4f10-bdab-52c6d3f15d88 for instance 871b2448-1f70-4437-bcac-c8e716de5346 on hv-cinder-84349 Jun 15 10:44:02.761977 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-ffe89584-9eed-4be2-90ad-fc076b0d4c7e req-6e0ad762-c868-42e0-80b0-e5b1164bba97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Jun 15 10:44:02.762599 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 559/1086] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:44:17.587464 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:17.588007 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=20 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:17.588377 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:17.588960 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=44 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:17.593425 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-b381b35a-21a9-4f38-8e48-65806c7eec3d req-58ca1d85-df0c-4cd2-b333-54945a5d13fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:44:17.593595 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:17.594283 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=48 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:17.600325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:17.600325 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:17.600771 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:17.601278 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:17.602116 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-b381b35a-21a9-4f38-8e48-65806c7eec3d req-58ca1d85-df0c-4cd2-b333-54945a5d13fc service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:17.602557 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-b381b35a-21a9-4f38-8e48-65806c7eec3d req-58ca1d85-df0c-4cd2-b333-54945a5d13fc service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:17.615733 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-b381b35a-21a9-4f38-8e48-65806c7eec3d req-58ca1d85-df0c-4cd2-b333-54945a5d13fc service nova] Creating event network-changed:94642a1a-1e5d-4c38-8e39-fe86241784ed for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e on hv-cinder-84349 Jun 15 10:44:17.620950 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-b381b35a-21a9-4f38-8e48-65806c7eec3d req-58ca1d85-df0c-4cd2-b333-54945a5d13fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034639 Jun 15 10:44:17.621791 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 560/1087] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:44:17.632040 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:44:17.720914 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-6ace7277-3fa3-46b2-97fe-696fbf2c5902 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 204 len: 0 microversion: 2.1 time: 0.137097 Jun 15 10:44:17.722051 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 528/1088] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:44:17 2022] DELETE /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:44:17.731238 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:17.731990 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:17.740556 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:17.741001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:17.741765 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:17.742199 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:17.889388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:44:17.897208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e4749059-51e6-4319-8e40-65c80655c153 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.170880 Jun 15 10:44:17.897774 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 561/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:44:17 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:44:18.915495 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:18.916196 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:18.923416 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:18.923867 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:18.924631 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:18.925069 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:19.054371 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:44:19.062549 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-41dbb27f-49cc-4f0c-8f53-5b441a4c9c82 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1565 microversion: 2.1 time: 0.151345 Jun 15 10:44:19.063142 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 529/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:44:18 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:44:20.079777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:20.080957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:20.087246 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:20.087688 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:20.088480 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:20.089495 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:20.153319 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b4d91a8096f4f70983ebad7e097a78a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe56b435fdbf49629bfc5e06c24e78b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:44:20.160850 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-16786d8a-cc95-418c-bff5-cd0d2151a6bc tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 200 len: 1380 microversion: 2.1 time: 0.085387 Jun 15 10:44:20.161501 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 562/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:44:20 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 1380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:44:20.173993 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-bc322e21-25a9-43f8-84bd-c60f9d96be3e req-7ff33419-20be-4d36-84dc-20ec7d69c453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6bfe90-7d7f-4905-b097-81c9bda21a3e", "name": "network-vif-deleted", "tag": "94642a1a-1e5d-4c38-8e39-fe86241784ed"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:44:20.184416 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-bc322e21-25a9-43f8-84bd-c60f9d96be3e req-7ff33419-20be-4d36-84dc-20ec7d69c453 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:20.184882 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-bc322e21-25a9-43f8-84bd-c60f9d96be3e req-7ff33419-20be-4d36-84dc-20ec7d69c453 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:20.196749 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-bc322e21-25a9-43f8-84bd-c60f9d96be3e req-7ff33419-20be-4d36-84dc-20ec7d69c453 service nova] Creating event network-vif-deleted:94642a1a-1e5d-4c38-8e39-fe86241784ed for instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e on hv-cinder-84349 Jun 15 10:44:20.201980 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-bc322e21-25a9-43f8-84bd-c60f9d96be3e req-7ff33419-20be-4d36-84dc-20ec7d69c453 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 Jun 15 10:44:20.202753 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 530/1092] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:44:21.177918 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:21.178515 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] [instance: 4f6bfe90-7d7f-4905-b097-81c9bda21a3e] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:44:21.184958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:21.185401 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:21.186149 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:44:21.186575 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:44:21.200059 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] HTTP exception thrown: Instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e could not be found. Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Request method failure captured: Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e HTTP/1.1 Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqbbdiJLILLqLUBAW5kG7WZsRoUPKotq8M7aLOHWa_qEzwzyXjYPS9JoC2Cz_Qf7k3y8g5flXc5zdQanR5fVRVzNz4zBDsBNZ4N7q-F9y8-dG_2EzbQvcQ4Prw2edC7xVilP7qjVsy1xVjovZJSyL1Vgh_6pZlEwSQh7SaKlOQgyjlIE Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: fe56b435fdbf49629bfc5e06c24e78b9 Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-TestShelveInstance-876281898 Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:44:21.201665 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fe56b435fdbf49629bfc5e06c24e78b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe56b435fdbf49629bfc5e06c24e78b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fe56b435fdbf49629bfc5e06c24e78b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fe56b435fdbf49629bfc5e06c24e78b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-TestShelveInstance-876281898 Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: fe56b435fdbf49629bfc5e06c24e78b9 Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-TestShelveInstance-876281898 Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-TestShelveInstance-876281898-project Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 0b4d91a8096f4f70983ebad7e097a78a Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-TestShelveInstance-876281898-project Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e could not be found. Jun 15 10:44:21.203527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '4f6bfe90-7d7f-4905-b097-81c9bda21a3e'} Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e could not be found. Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:44:21.204572 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e could not be found. Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e could not be found. Jun 15 10:44:21.206196 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:44:21.207727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Returning 404 to user: Instance 4f6bfe90-7d7f-4905-b097-81c9bda21a3e could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:44:21.207727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-e915d76a-e3f6-48ae-9b26-d7069cb10a76 tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e" status: 404 len: 111 microversion: 2.1 time: 0.029108 Jun 15 10:44:21.207727 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 563/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:44:21 2022] GET /compute/v2.1/servers/4f6bfe90-7d7f-4905-b097-81c9bda21a3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:44:21.360145 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-ce2a9013-761f-42d2-b9e3-408bd81537aa tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] Calling method '.version_select at 0x7feb3abd48b0>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:44:21.385902 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-ce2a9013-761f-42d2-b9e3-408bd81537aa tempest-TestShelveInstance-876281898 tempest-TestShelveInstance-876281898-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-129318747" status: 202 len: 0 microversion: 2.1 time: 0.029700 Jun 15 10:44:21.390808 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 531/1094] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Jun 15 10:44:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-129318747 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:44:56.496710 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:44:56.497297 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Wed Jun 15 10:44:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:45:32.585217 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_api:SELECT=8 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.585957 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG dbcounter [-] [118864] Writing DB stats nova_cell1:SELECT=16 {{(pid=118864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.589892 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.590388 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.590803 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-44496e97-8e05-4dce-8bc8-8f184c8bc0bb req-c1bd1966-646a-4992-af61-6b943e982141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "871b2448-1f70-4437-bcac-c8e716de5346", "tag": "0309f496-3d06-4f10-bdab-52c6d3f15d88"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:32.596243 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.596972 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG dbcounter [-] [118865] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.600547 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.601006 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.601803 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.602214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.604274 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-44496e97-8e05-4dce-8bc8-8f184c8bc0bb req-c1bd1966-646a-4992-af61-6b943e982141 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.604911 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-44496e97-8e05-4dce-8bc8-8f184c8bc0bb req-c1bd1966-646a-4992-af61-6b943e982141 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.618301 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-44496e97-8e05-4dce-8bc8-8f184c8bc0bb req-c1bd1966-646a-4992-af61-6b943e982141 service nova] Creating event network-changed:0309f496-3d06-4f10-bdab-52c6d3f15d88 for instance 871b2448-1f70-4437-bcac-c8e716de5346 on hv-cinder-84349 Jun 15 10:45:32.623591 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-44496e97-8e05-4dce-8bc8-8f184c8bc0bb req-c1bd1966-646a-4992-af61-6b943e982141 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037570 Jun 15 10:45:32.624366 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 532/1095] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:32.631273 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Going to try to terminate instance {{(pid=118864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:45:32.718243 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-266087d2-fc08-46be-8cbe-d1edd0161dee tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 204 len: 0 microversion: 2.1 time: 0.134389 Jun 15 10:45:32.719424 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 564/1096] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:45:32 2022] DELETE /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:45:32.728311 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:32.729049 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:32.736443 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.736897 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.737667 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:32.738101 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:32.870430 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:32.878307 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-901148ca-19c1-40a2-b2fe-2b724153c07b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1574 microversion: 2.1 time: 0.154206 Jun 15 10:45:32.878879 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 533/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:32 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:45:33.896375 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:33.897082 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:33.903740 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.904189 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:33.904950 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:33.905384 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:34.040618 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:34.048637 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-4b4ea8f9-0dbe-4aff-924c-5b06d349c8ad tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1574 microversion: 2.1 time: 0.156517 Jun 15 10:45:34.049192 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 565/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:33 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:45:35.066492 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:35.067225 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:35.074206 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.074650 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.075453 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.075889 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.447028 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:35.454648 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-33fcaecc-7de1-4749-8b67-f23fbf41c1ea tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1455 microversion: 2.1 time: 0.392683 Jun 15 10:45:35.455241 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 534/1099] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:35 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1455 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:35.583552 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-e229d41b-31ff-481b-b2f7-144d8d706c0e req-157955b9-bbc1-4ca1-95b3-ae65dedaab77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "871b2448-1f70-4437-bcac-c8e716de5346", "name": "network-vif-deleted", "tag": "0309f496-3d06-4f10-bdab-52c6d3f15d88"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:35.593286 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-e229d41b-31ff-481b-b2f7-144d8d706c0e req-157955b9-bbc1-4ca1-95b3-ae65dedaab77 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:35.594214 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-e229d41b-31ff-481b-b2f7-144d8d706c0e req-157955b9-bbc1-4ca1-95b3-ae65dedaab77 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:35.605433 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-e229d41b-31ff-481b-b2f7-144d8d706c0e req-157955b9-bbc1-4ca1-95b3-ae65dedaab77 service nova] Creating event network-vif-deleted:0309f496-3d06-4f10-bdab-52c6d3f15d88 for instance 871b2448-1f70-4437-bcac-c8e716de5346 on hv-cinder-84349 Jun 15 10:45:35.610777 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-e229d41b-31ff-481b-b2f7-144d8d706c0e req-157955b9-bbc1-4ca1-95b3-ae65dedaab77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030948 Jun 15 10:45:35.611380 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 566/1100] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:36.473137 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:36.473747 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:36.480805 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.481250 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.482003 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.482435 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.516007 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:36.516452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:36.516896 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.objects.instance [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lazy-loading 'fault' on Instance uuid 871b2448-1f70-4437-bcac-c8e716de5346 {{(pid=118865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 10:45:36.557701 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:36.565452 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-7d3611fa-0e79-49ab-bd89-2480d4499a1d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 200 len: 1230 microversion: 2.1 time: 0.097504 Jun 15 10:45:36.566011 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 535/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:36 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:37.583172 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:37.583896 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 871b2448-1f70-4437-bcac-c8e716de5346] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:37.590084 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:37.590527 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.591306 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:37.591737 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:37.604591 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] HTTP exception thrown: Instance 871b2448-1f70-4437-bcac-c8e716de5346 could not be found. Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Request method failure captured: Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 HTTP/1.1 Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqba0Dv-YHkugaAJk__5NTv1ymhZ1SRwd-U7UHKovip0TblvQlc4OqSLybfqxdbihXPO_zSYDU7SUi61B5gM4xTDy8ZlMLNh02HQkrHeXNMA885kdnn5y_Re4doJy1R7hQxlDmuSkc6_KO6w5amdEp_BJPYhgxGD8IHgqVvEsz06DJ8Q Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:45:37.606153 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 61bc9ad2c9444fc297eb4b5902a67b98 Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 871b2448-1f70-4437-bcac-c8e716de5346 could not be found. Jun 15 10:45:37.607856 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '871b2448-1f70-4437-bcac-c8e716de5346'} Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871b2448-1f70-4437-bcac-c8e716de5346 could not be found. Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:37.609498 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871b2448-1f70-4437-bcac-c8e716de5346 could not be found. Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871b2448-1f70-4437-bcac-c8e716de5346 could not be found. Jun 15 10:45:37.611180 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:37.612693 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Returning 404 to user: Instance 871b2448-1f70-4437-bcac-c8e716de5346 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:37.612693 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-9e5f4190-5a46-4bc7-a96d-61d5f41f4b00 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346" status: 404 len: 111 microversion: 2.1 time: 0.028975 Jun 15 10:45:37.612693 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 567/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:37 2022] GET /compute/v2.1/servers/871b2448-1f70-4437-bcac-c8e716de5346 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:40.627343 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:40.628030 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:40.629207 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [req-b61e4bc3-792b-4c30-b2a9-8c71e1d1d386 req-c26c6f07-7f21-4458-8e88-5144cce09665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124aa8d6-54b1-4c24-821b-e022b8752904", "tag": "27606219-e918-4e9a-aa30-81725e2a94e1"}]} {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:40.634862 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.635606 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.636639 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.637161 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.637871 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-b61e4bc3-792b-4c30-b2a9-8c71e1d1d386 req-c26c6f07-7f21-4458-8e88-5144cce09665 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.638318 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [req-b61e4bc3-792b-4c30-b2a9-8c71e1d1d386 req-c26c6f07-7f21-4458-8e88-5144cce09665 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.651295 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.compute.server_external_events [req-b61e4bc3-792b-4c30-b2a9-8c71e1d1d386 req-c26c6f07-7f21-4458-8e88-5144cce09665 service nova] Creating event network-changed:27606219-e918-4e9a-aa30-81725e2a94e1 for instance 124aa8d6-54b1-4c24-821b-e022b8752904 on hv-cinder-84349 Jun 15 10:45:40.656409 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [req-b61e4bc3-792b-4c30-b2a9-8c71e1d1d386 req-c26c6f07-7f21-4458-8e88-5144cce09665 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031348 Jun 15 10:45:40.657001 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 568/1103] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 10:45:40.665977 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Going to try to terminate instance {{(pid=118865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 10:45:40.752567 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-a3495b15-1de8-418f-87fe-44affc5d919b tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 204 len: 0 microversion: 2.1 time: 0.128908 Jun 15 10:45:40.753617 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 536/1104] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:45:40 2022] DELETE /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 10:45:40.763830 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:40.764949 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:40.771919 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.772623 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.773565 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:40.774160 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:40.906398 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:40.914156 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f85f7d0b-b90c-43cb-bd36-ea1fa730c1d5 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1573 microversion: 2.1 time: 0.156113 Jun 15 10:45:40.914729 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 569/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:40 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:41.933191 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:41.933892 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:41.940927 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.941372 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:41.942134 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:41.942572 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:42.074025 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.policy [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118865) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:42.082226 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-592246d9-9242-4f5f-930f-526226631d12 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1573 microversion: 2.1 time: 0.153245 Jun 15 10:45:42.082784 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 537/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:41 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 10:45:43.099045 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:43.099998 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:43.106852 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.107489 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.108518 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.109502 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.250958 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.policy [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61bc9ad2c9444fc297eb4b5902a67b98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f096e399deac4d029ff63e3cb7f1ce9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118864) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 10:45:43.260079 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [req-1f61b332-7340-44f9-a874-4f6971495e4a req-e7744ef9-b904-4b62-9047-8817ca2f77a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124aa8d6-54b1-4c24-821b-e022b8752904", "name": "network-vif-deleted", "tag": "27606219-e918-4e9a-aa30-81725e2a94e1"}]} {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 10:45:43.269666 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1f61b332-7340-44f9-a874-4f6971495e4a req-e7744ef9-b904-4b62-9047-8817ca2f77a6 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:43.270105 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [req-1f61b332-7340-44f9-a874-4f6971495e4a req-e7744ef9-b904-4b62-9047-8817ca2f77a6 service nova] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:43.270343 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-f61b88b8-1dab-472b-85bf-df0e32e7472e tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 200 len: 1455 microversion: 2.1 time: 0.175093 Jun 15 10:45:43.271004 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 570/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:43 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 10:45:43.281291 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.compute.server_external_events [req-1f61b332-7340-44f9-a874-4f6971495e4a req-e7744ef9-b904-4b62-9047-8817ca2f77a6 service nova] Creating event network-vif-deleted:27606219-e918-4e9a-aa30-81725e2a94e1 for instance 124aa8d6-54b1-4c24-821b-e022b8752904 on hv-cinder-84349 Jun 15 10:45:43.286679 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [req-1f61b332-7340-44f9-a874-4f6971495e4a req-e7744ef9-b904-4b62-9047-8817ca2f77a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030562 Jun 15 10:45:43.287286 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 538/1108] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Jun 15 10:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 10:45:44.287947 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:44.288579 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 124aa8d6-54b1-4c24-821b-e022b8752904] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:44.295038 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.295514 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.296261 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.297242 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.310295 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] HTTP exception thrown: Instance 124aa8d6-54b1-4c24-821b-e022b8752904 could not be found. Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Request method failure captured: Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 HTTP/1.1 Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqba0Dv-YHkugaAJk__5NTv1ymhZ1SRwd-U7UHKovip0TblvQlc4OqSLybfqxdbihXPO_zSYDU7SUi61B5gM4xTDy8ZlMLNh02HQkrHeXNMA885kdnn5y_Re4doJy1R7hQxlDmuSkc6_KO6w5amdEp_BJPYhgxGD8IHgqVvEsz06DJ8Q Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:45:44.311924 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 61bc9ad2c9444fc297eb4b5902a67b98 Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 124aa8d6-54b1-4c24-821b-e022b8752904 could not be found. Jun 15 10:45:44.313535 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '124aa8d6-54b1-4c24-821b-e022b8752904'} Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124aa8d6-54b1-4c24-821b-e022b8752904 could not be found. Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:44.314428 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124aa8d6-54b1-4c24-821b-e022b8752904 could not be found. Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124aa8d6-54b1-4c24-821b-e022b8752904 could not be found. Jun 15 10:45:44.316076 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.317635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Returning 404 to user: Instance 124aa8d6-54b1-4c24-821b-e022b8752904 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:44.317635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-1b56b93e-fd28-4a75-a5a0-1fc9a5eff25c tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904" status: 404 len: 111 microversion: 2.1 time: 0.029240 Jun 15 10:45:44.317635 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 571/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:44 2022] GET /compute/v2.1/servers/124aa8d6-54b1-4c24-821b-e022b8752904 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:44.743722 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:44.744299 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.compute.api [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118865) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:44.751042 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.751514 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.752262 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.752688 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG oslo_concurrency.lockutils [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.766835 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.wsgi [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] HTTP exception thrown: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Request method failure captured: Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: request: DELETE /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 HTTP/1.1 Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept: application/json Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Accept-Encoding: identity Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Connection: close Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Length: 0 Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Content-Type: application/json Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Host: 10.222.0.49 Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Openstack-System-Scope: None Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Auth-Token: gAAAAABiqba0Dv-YHkugaAJk__5NTv1ymhZ1SRwd-U7UHKovip0TblvQlc4OqSLybfqxdbihXPO_zSYDU7SUi61B5gM4xTDy8ZlMLNh02HQkrHeXNMA885kdnn5y_Re4doJy1R7hQxlDmuSkc6_KO6w5amdEp_BJPYhgxGD8IHgqVvEsz06DJ8Q Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Id: None Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Domain-Name: None Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Identity-Status: Confirmed Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Is-Admin-Project: True Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Id: default Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Domain-Name: Default Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Project-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Role: member,reader Jun 15 10:45:44.768511 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Roles: member,reader Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-Tenant-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Id: default Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Domain-Name: Default Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Id: 61bc9ad2c9444fc297eb4b5902a67b98 Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: X-User-Name: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: method: > Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: exception: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.770095 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: action_args: {'id': '2626cd15-7eaf-42ac-adce-e523831ee0c7'} Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:44.771164 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.772781 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.774644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Returning 404 to user: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. {{(pid=118865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:44.774644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-46365ba6-f305-4877-9530-879cbd4e587d tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 404 len: 111 microversion: 2.1 time: 0.030839 Jun 15 10:45:44.774644 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 539/1110] 10.222.0.49 () {58 vars in 1238 bytes} [Wed Jun 15 10:45:44 2022] DELETE /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:44.778418 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '>' {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:44.779029 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.compute.api [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] [instance: 2626cd15-7eaf-42ac-adce-e523831ee0c7] Fetching instance by UUID {{(pid=118864) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 10:45:44.785921 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.786407 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.787208 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 10:45:44.787645 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG oslo_concurrency.lockutils [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Lock "ed046e13-dc35-409c-a39d-d673ce8dff73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 10:45:44.801306 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.wsgi [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] HTTP exception thrown: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Request method failure captured: Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: request: GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 HTTP/1.1 Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept: application/json Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Accept-Encoding: identity Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Connection: close Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Length: 0 Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Content-Type: application/json Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Host: 10.222.0.49 Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Openstack-System-Scope: None Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: User-Agent: python-urllib3/1.26.9 Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Auth-Token: gAAAAABiqba0Dv-YHkugaAJk__5NTv1ymhZ1SRwd-U7UHKovip0TblvQlc4OqSLybfqxdbihXPO_zSYDU7SUi61B5gM4xTDy8ZlMLNh02HQkrHeXNMA885kdnn5y_Re4doJy1R7hQxlDmuSkc6_KO6w5amdEp_BJPYhgxGD8IHgqVvEsz06DJ8Q Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Id: None Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Domain-Name: None Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Identity-Status: Confirmed Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Is-Admin-Project: True Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Id: default Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Domain-Name: Default Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Project-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Role: member,reader Jun 15 10:45:44.802811 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Roles: member,reader Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f096e399deac4d029ff63e3cb7f1ce9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}] Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Id: f096e399deac4d029ff63e3cb7f1ce9f Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1599265714 Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Id: default Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Domain-Name: Default Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Id: 61bc9ad2c9444fc297eb4b5902a67b98 Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: X-User-Name: tempest-TestVolumeBootPattern-1599265714-project Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: method: > Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: exception: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.804477 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: action_args: {'id': '2626cd15-7eaf-42ac-adce-e523831ee0c7'} Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: {{(pid=118864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 10:45:44.805399 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. Jun 15 10:45:44.807232 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: ERROR nova.api.openstack.wsgi Jun 15 10:45:44.808585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: DEBUG nova.api.openstack.wsgi [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Returning 404 to user: Instance 2626cd15-7eaf-42ac-adce-e523831ee0c7 could not be found. {{(pid=118864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 10:45:44.808585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO nova.api.openstack.requestlog [None req-dfea9919-1424-4664-bbf0-07143be9c004 tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7" status: 404 len: 111 microversion: 2.1 time: 0.029684 Jun 15 10:45:44.808585 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: [pid: 118864|app: 0|req: 572/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed Jun 15 10:45:44 2022] GET /compute/v2.1/servers/2626cd15-7eaf-42ac-adce-e523831ee0c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 10:45:46.083597 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: DEBUG nova.api.openstack.wsgi [None req-74d748bf-499c-4aa9-a840-3a595a9213db tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] Calling method '.version_select at 0x7feb3ab9f280>' {{(pid=118865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 10:45:46.101156 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO nova.api.openstack.requestlog [None req-74d748bf-499c-4aa9-a840-3a595a9213db tempest-TestVolumeBootPattern-1599265714 tempest-TestVolumeBootPattern-1599265714-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2010066906" status: 202 len: 0 microversion: 2.1 time: 0.021261 Jun 15 10:45:46.101721 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: [pid: 118865|app: 0|req: 540/1112] 10.222.0.49 () {58 vars in 1262 bytes} [Wed Jun 15 10:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2010066906 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 10:46:27.726721 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:46:27.727508 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Wed Jun 15 10:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:48:00.680704 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:48:00.681326 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Wed Jun 15 10:48:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:48:16.504363 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:48:16.504953 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Wed Jun 15 10:48:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:48:27.155000 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:48:27.155653 dv-cinder-843493-2-iscsi devstack@n-api.service[118864]: Wed Jun 15 10:48:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:49:47.735731 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:49:47.736221 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Wed Jun 15 10:49:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 10:51:02.863904 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 10:51:02.864494 dv-cinder-843493-2-iscsi devstack@n-api.service[118865]: Wed Jun 15 10:51:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!